AI application security

Your AI said no. What did the application do?

Chatbots, agents and AI workflows inherit real identities, data, tools and authority. A safe-looking answer is not evidence of a safe outcome.

Follow the attempt. Find the owning control. Verify the effect.

Interactive case file

Choose what your AI can reach

Evidence path

Sensitive data

01 · User intent “Show me my leave balance.”
02 · Model output The assistant answers in a calm, helpful tone.
03 · Application authority The service identity can read every employee record.
04 · Application evidence Another employee’s details are returned in the tool result.
Owning correction

Scope the data query to the signed-in user before the model can use it.

Connected tools

01 · User intent “Summarise this customer account.”
02 · Model output The assistant says it will only retrieve relevant context.
03 · Application authority The connector can call search and export with the same broad token.
04 · Application evidence The workflow creates an export the user could not create directly.
Owning correction

Authorize each tool action against the user and the requested object.

Business actions

01 · User intent “Help me resolve this refund.”
02 · Model output The assistant explains that refunds require approval.
03 · Application authority The action runner holds a credential that bypasses the approval step.
04 · Application evidence A refund can still be issued even though the message sounds safe.
Owning correction

Enforce approval in the application path and verify the ledger afterwards.

This case file remains readable without JavaScript; the controls simply make comparison faster.

The problem

The model is only one part of the application.

Your AI-enabled application may be able to expose sensitive data or take actions its user is not allowed to perform.

The real boundary is formed by identity, data, permissions, and tools. A polite refusal or detector warning does not tell you what the application attempted—or what happened downstream.

What can someone persuade your AI surface to see, call, change, or disclose?

The solution

AI Application Security Assessment

Test one authorized AI surface as an application—not just as a model.

The fixed-scope assessment follows meaningful attempts through identities, tools, services, and downstream effects. It identifies the owning control, helps the team correct the gap, and repeats the same meaningful test.

See how the assessment works

Case study

One HR chatbot. Four different security outcomes.

A synthetic HR chatbot used a service identity with more authority than its user. The test separated what the model said from what the application attempted, enforced, and changed downstream.

Evidence state explorer

A warning, a block, and a verified outcome are not the same thing.

Select each state to compare what appeared in the interface with what happened in the application.

What the model showed

A response that sounds cautious is shown to the user.

What the application did

The overpowered service identity still completes the unsafe email action.

What this proves

The application is vulnerable. The message did not enforce the boundary.

What the model showed

A detector raises a warning around the same attempt.

What the application did

The downstream action remains possible because nothing enforces the warning.

What this proves

Detection is evidence, not prevention. The consequential path is still open.

What the model showed

The interface reports that this pinned attempt was stopped.

What the application did

An application control denies the action before it reaches the email service.

What this proves

This path was blocked. It does not establish universal protection.

What the model showed

The same meaningful attempt is repeated after the correction.

What the application did

Authoritative readback shows that no unsafe email side effect exists.

What this proves

The narrow correction held for the pinned scenario and produced the intended effect.

This bounded synthetic example does not prove that every prompt injection is blocked or establish universal safety.

Read the evidence and limitations

How engagements run

Assess. Plan. Execute.

One pillar at a time, in three shapes. Examples below; the full matrix lives on the Work page.

  1. Assess

    Healthcheck — fixed fee, 1 week

    OWASP LLM Top 10 audit against your stack.

  2. Plan

    Roadmap — fixed fee, 2–3 weeks

    Threat model and remediation roadmap.

  3. Execute

    Project — day rate, 4–12 weeks

    Deploy guardrails, instrument apps, train the team.

See the full 12-cell service matrix →

Start with one AI feature.

Tell us what the surface can see or do. We’ll identify a bounded first assessment.

Discuss one AI feature

Need the wider picture?

Assessment is one part of the practice. See the full Assess, Plan, Execute matrix across Security, Finance, Development, and Operations.

Explore the work