
Guide · 2026
AI for law firms: a privilege-safe architecture (2026)
Client privilege makes generic AI advice useless to a law firm: the risk isn't whether AI is capable, it's whether privileged material ever leaves a jurisdiction, a network boundary, or a vendor's abuse-monitoring queue. This guide sets out the three-part architecture and six safeguards that let a firm deploy Azure AI Foundry without that risk — and a cost model that comes in well under typical per-seat legal AI pricing.
- —Azure OpenAI and Azure AI Foundry don't train on your prompts by default, but they do retain them for up to 30 days of abuse monitoring — apply for Microsoft's modified abuse monitoring exemption before going live with privileged material.
- —A privilege-safe deployment needs three components (model, document index, interface) inside a firm-owned Azure tenant, plus network isolation, no-training terms, an audit trail and matter-level index isolation.
- —The pattern is materially cheaper than per-seat legal AI SaaS once a firm passes a handful of users — typically £150-350/month running cost against £100-300 per user for off-the-shelf products.
- —The same pattern applies to any regulated industry with a confidentiality duty stricter than general data protection law — healthcare and financial services included, with the nouns changed.
Why the default AI answer doesn't hold up
Legal professional privilege belongs to the client, not the firm, and it's backed by professional conduct rules that don't bend for "the AI probably didn't read it." That changes the risk calculation entirely. Generic enterprise AI advice — "Microsoft is enterprise-grade, you're covered" — is true up to a point, and dangerously incomplete past it.
Azure OpenAI and Azure AI Foundry don't train the base models on your prompts. That part holds up. But by default, Microsoft retains prompts and completions for up to 30 days for abuse monitoring, and in flagged cases a human reviewer can read that content. For most customers that's irrelevant. For a firm pasting in draft settlement terms, it's a stranger reading privileged material without the client's knowledge.
The fix is a real, specific thing: Microsoft runs a Limited Access / modified abuse monitoring process for customers handling sensitive or regulated data. Apply, get approved, and that logging switches off for your tenant. Almost no firm knows to ask.
The pattern: three components, six safeguards
Every privilege-safe AI assistant comes down to three components, all inside a tenant the firm controls rather than a third-party SaaS product:
| Component | Role | Where it runs |
|---|---|---|
| The model | Reasoning engine (e.g. GPT-4o via Azure AI Foundry) | UK Azure region, billed per query |
| The index | The firm's own precedents and matter notes, made searchable | The firm's own storage account |
| The interface | How staff reach it — web chat or built into Teams/Outlook | The firm's own tenant |
Six safeguards close the specific gaps a generic deployment leaves open:
| Safeguard | Closes this risk |
|---|---|
| UK data residency | Data never leaves the jurisdiction the client expects |
| Network isolation (private endpoint, no public access) | No path for the data plane to leak over the open internet |
| Contractual exclusion from model training | Client material never ends up baked into a shared model |
| Modified abuse monitoring | No Microsoft reviewer ever sees flagged privileged content |
| Full audit logging | The firm has its own record of who asked what, when |
| Matter-level index isolation | One client's material can't surface in another client's answers — the AI equivalent of a conflict check |
Locking the network down is a few lines of Bicep:
resource disablePublicAccess 'Microsoft.CognitiveServices/accounts@2024-10-01' = {
name: foundryAccountName
properties: {
publicNetworkAccess: 'Disabled'
networkAcls: { defaultAction: 'Deny' }
}
}
resource privateEndpoint 'Microsoft.Network/privateEndpoints@2023-11-01' = {
name: '${foundryAccountName}-pe'
location: location
properties: {
subnet: { id: subnetId }
privateLinkServiceConnections: [{
name: '${foundryAccountName}-plsc'
properties: { privateLinkServiceId: foundry.id, groupIds: ['account'] }
}]
}
}
None of this is exotic — it's the same private-endpoint pattern used to lock down any Azure PaaS resource. What's different is the decision to bother, because most AI deployments never disable public access simply because nobody told them it was on.
What it actually costs
| Item | Monthly cost |
|---|---|
| Model usage (5-10 staff, moderate use) | £50-150 |
| Document index | £65-75 |
| Private networking | £10-20 |
| Storage | under £5 |
| Interface (nil if built into Teams) | £0-50 |
| Total | £150-350/month |
Build cost — tenant setup, network lockdown, document indexing, the abuse-monitoring exemption application — typically runs £3,000-8,000 as a one-off, with a working system in two to three weeks.
Compare that to off-the-shelf legal AI SaaS, which typically charges £100-300 per user, per month. A ten-person firm on a per-seat product is paying £1,000-3,000/month for something with less control over where the data actually sits. Past a handful of users, the self-hosted pattern is usually cheaper within the first year — as well as safer.
The rule generalises past legal
Swap "privilege" for "patient confidentiality" and the same architecture applies to a healthcare provider handling special category data under UK GDPR. Swap it for "client money and market-sensitive information" and it's the pattern for an FCA-regulated advisory firm. The regulator changes; the shape of the problem doesn't:
- A duty of confidentiality exists that's stricter than general data protection law.
- The default AI vendor configuration wasn't built with that duty in mind.
- A safer configuration exists, but it has to be requested, not assumed.
If your organisation has a professional body, a statutory duty, or a client relationship built on confidentiality, this checklist applies with the nouns changed.
Getting help
We build privilege-safe Azure AI deployments for firms that can't treat "probably fine" as an acceptable answer — from the tenant and network design through the abuse-monitoring exemption to the document index itself.
Related: Azure AI Foundry: a practical guide, Azure AI landing zone, Azure AI Foundry consultancy and Azure AI cost management.
Asked and answered.
Does Azure OpenAI train on law firm data submitted through prompts?+
No — under Microsoft's Product Terms, prompts and completions sent to Azure OpenAI and Azure AI Foundry are not used to train the underlying models and are not shared with other customers. The separate risk is abuse monitoring, not model training, and it needs asking about specifically before deployment.
What is Microsoft's modified abuse monitoring, and why does a law firm need it?+
By default, Azure OpenAI retains prompts and completions for up to 30 days so Microsoft can detect abuse, and in flagged cases a human reviewer can read the content. Firms handling privileged material can apply for Limited Access / modified abuse monitoring, which disables that logging and review for their tenant.
Is a self-hosted AI assistant cheaper than legal AI software?+
Usually, once a firm has more than a handful of users. A self-hosted Azure AI Foundry deployment typically runs £150-350 a month plus a one-off build cost, against £100-300 per user, per month for off-the-shelf legal AI products — with the firm keeping full control of where the data sits.