Insights

AI Data Leakage: What Actually Leaks, and What DLP Catches

The five routes company data reaches AI services, why classic data loss prevention misses the dominant one, and what actually reduces the risk without an enterprise platform.

By Alexej Pikovsky  ·  Updated

AI data leakage is company or client information ending up in a third-party AI service, where it may be retained, may be used to improve a model, and cannot be retrieved. It is the risk that turned AI governance from a policy conversation into a security one, and it is genuinely different from the data-loss problems that came before it.

This page covers how it actually happens, what traditional data loss prevention does and does not catch, and what is worth doing about it at a company that is not going to buy an enterprise security platform.

The five routes, and which one dominates

Leakage happens through a paste, an upload, an AI feature inside a tool you already approved, an agent with access to a folder, or a browser extension reading the page. In most companies the first route accounts for the overwhelming majority, and it is the one your existing controls are least equipped to see.

Where AI data leakage actually happens ยท alexejpikovsky.com
pasted into a chat window uploaded as a file an AI feature inside an approved tool an agent with access to a folder a browser extension reading the page
Classic DLP was built to inspect files and email attachments leaving a network. The first and most common route here is a human typing into a text box on a reputable website, which produces no file, no attachment and no anomalous destination.

What classic DLP catches, and what it does not

Data loss prevention was designed around a model of how data leaves: as a file, an attachment, or a bulk transfer, crossing a network boundary you control, towards a destination that could be evaluated. Every part of that model is a poor fit here.

There is no file. Someone selects three paragraphs of a contract and pastes them into a text box. No attachment, no document, nothing for a file-oriented inspector to hold.

The destination is reputable. The major AI services are widely used business tools on any sensible allowlist. Destination reputation, the signal much filtering leans on, tells you nothing.

The traffic is encrypted and ordinary. Distinguishing a person pasting a client list from a person asking for help with an email requires inspecting content at the point it is typed, not in transit.

Increasingly there is no boundary. Home working, personal devices and mobile mean a large share of this activity never crosses a network you monitor.

That is not an argument that DLP is useless. Existing tooling still catches uploads and attachments, which are real routes. It is an argument against the assumption that having DLP means this risk is handled, which is a conclusion a lot of companies have quietly reached.

What actually reduces the risk

In order of effect per unit of effort, which is roughly the reverse of how the market sells it.

Provide a sanctioned tool on a business tier. The single highest-impact action, and it is procurement rather than security. Business and enterprise tiers of the major services generally do not train on submitted content, where consumer tiers generally do by default. Moving your staff from personal accounts to a company tenant changes the terms the data lands under, and it does so for every route at once. Check the specific tier's current terms rather than any summary, including this one.

Say which data must never go in. A short, memorable rule beats a long taxonomy. People can hold three categories in their head at the moment they are about to paste, which is the only moment that matters. The rule belongs in a policy people have signed.

Find out what is actually in use. You cannot reason about exposure through tools you do not know about, and most of the discovery methods cost nothing: the six detection methods.

Turn off what you are not using. AI features inside existing software, enabled by default in an update nobody read, are exposure you get no value from. Auditing your existing vendors' AI settings is an afternoon and removes risk without removing capability.

Then, if the exposure justifies it, consider tooling. Point-of-use inspection products exist and some are good. They are worth evaluating after the four steps above, not before, because each of those steps reduces the problem the tool would be bought to solve.

The property that makes this different

Most security incidents have a remediation path. A leaked credential gets rotated. A misconfigured bucket gets closed. An infected endpoint gets rebuilt.

Text submitted to a third-party model has no equivalent. You can delete a conversation, and that does not unwind whatever processing already happened under terms nobody read. There is no rotation, no recall, and no way to make it not have occurred.

That asymmetry is why the prevention side deserves more weight here than the detection side, and it is why a warning at the moment of paste is worth more than a report at the end of the month. A report tells you about an event that is already permanent.

FAQ

What is AI data leakage?

Company or client information reaching a third-party AI service where it may be retained or used to improve a model, and cannot be retrieved. It happens through five routes: text pasted into a chat window, files uploaded, AI features inside already-approved software, agents with access to file storage, and browser extensions reading page content. Pasting dominates in most organisations.

Does DLP stop AI data leakage?

Partially at best. Data loss prevention was built around files, attachments and bulk transfers crossing a monitored boundary toward evaluable destinations. The dominant AI leakage route produces no file, targets a reputable and widely allowlisted destination, and increasingly does not cross a monitored network at all because of home working and personal devices. Existing DLP still catches uploads and attachments, so it retains value, but treating its presence as evidence the risk is handled is a mistake.

How do you prevent employees leaking data to AI tools?

The highest-impact action is procurement rather than security: provide a sanctioned tool on a business or enterprise tier, since those tiers generally do not train on submitted content while consumer tiers generally do by default. Then state a short memorable rule about which data must never go in, discover what is actually in use, and disable AI features enabled by default in software you already own. Point-of-use inspection tooling is worth evaluating after those steps, because each one shrinks the problem it would be bought to solve.

Why is AI data leakage worse than other data incidents?

Because it is irreversible. Most security incidents have a remediation path: credentials rotate, buckets close, endpoints rebuild. Text submitted to a third-party model has no equivalent. Deleting the conversation does not unwind processing that already occurred under whatever terms applied. That asymmetry is why prevention at the moment of submission is worth more than detection after the fact, since a report describes an event that is already permanent.