Privacy engineering for AI systems

Privacy-by-design architecture

Build privacy decisions into the agent architecture

Privacy-by-design architecture becomes relevant when a proposed agent design distributes personal information before privacy requirements have been translated into system boundaries. A focused review would examine a data and control boundary across collection, processing, storage and tool execution. This is most relevant to enterprise architects and privacy engineering leads, especially where teams must distinguish privacy policy and enforced architecture.

Locate the privacy question inside the processing path

Functional and privacy requirements
Establish the processing activity and the information boundary.
Privacy policy
Identify the condition requiring a separate technical check.
Access, retention and recovery constraints
Expose the downstream conditions that qualify the conclusion.
A privacy validation and implementation backlog
Route unresolved questions to the appropriate decision owner.
Technical privacy findings do not determine lawful processing, authorise transfers or certify compliance.

Decision at stake

Build privacy decisions into the agent architecture

Make the decision explicit

Enterprise architects and privacy engineering leads
A proposed agent design distributes personal information before privacy requirements have been translated into system boundaries.
Decision
Which architectural choices can limit unnecessary exposure while supporting the intended workflow.
Privacy policy
Use functional and privacy requirements to establish the relevant starting condition.
Relevant where these conditions apply; engagement scope is agreed separately.

For enterprise architects and privacy engineering leads, the immediate question is which architectural choices can limit unnecessary exposure while supporting the intended workflow. This is most useful when there is a real choice between proceeding, changing the design, collecting more evidence or narrowing the intended use. The starting conversation should identify that choice and its consequence before deciding how much work the topic warrants.

A design could rely on a policy instruction while sending full records to every component involved in the task. A useful review follows a data and control boundary across collection, processing, storage and tool execution, rather than stopping at a convenient component metric or document boundary. The evidence should separate observation, interpretation and recommendation so the accountable owner can see what it supports.

Coverage

Privacy policy and enforced architecture need different evidence

Keep the review distinctions visible

Privacy policy
Check enforced architecture separately.
Centralized convenience
Check exposure boundary separately.
Data availability
Check necessary use separately.
Review questions—not evidence of completed testing.

Privacy policy versus enforced architecture

Architecture options would examine where information is collected, transformed and sent. A purpose-specific interface that supplies a narrow field set would be compared with unrestricted access to a complete source record.

Centralized convenience versus exposure boundary

Enforcement would be located at relevant retrieval, tool and storage boundaries. The design would ask how a denied or ambiguous request behaves, including whether error handling creates another unnecessary information path.

Data availability versus necessary use

Privacy conditions would become implementation and validation requirements. The architecture proposal would identify what can be observed locally and what depends on provider evidence or qualified legal and privacy decisions.

Illustrative scenario

Order-status request: examine what changes the decision

Examine the constructed decision boundary

Illustrative scenario

  1. Order-status request

    The assistant receives an entire customer profile for a narrow question.

  2. Reduced exposure

    Compare limited retrieval and purpose-specific interfaces against task needs.

  3. Architecture proposal

    Carry untested privacy conditions into the validation plan.

Illustrative scenario; no observed result implied.

Imagine a fictional account-support agent that needs an order status but receives a complete customer profile. The proposed architecture work would examine narrower retrieval, purpose-specific interfaces and separation of retained state. Candidate designs would be compared against task requirements and validation effort. The result would be an architectural proposal with testable privacy conditions, not a claim of compliant implementation.

The narrower interface might satisfy ordinary status requests but fail on disputed orders. The proposed architecture would identify an approved exception path instead of restoring full-profile access for every request. That tradeoff would be tested with representative cases, allowing privacy and product owners to evaluate the same concrete design. These are hypothetical decision paths, not observed client outcomes.

Prerequisites

Start with functional and privacy requirements

Give each input a specific job

Context neededFunctional and privacy requirements
Defines the operating boundary.
Examination materialArchitecture and provider options
Examine centralized convenience.
Operating dependencyAccess, retention and recovery constraints
Shows conditions affecting data availability.
ParticipationPrivacy and data owner
Confirm access and a reviewer who can resolve gaps.
Use sanitised material; preserve evidence gaps.

For Privacy-by-design architecture, a named data owner should approve the evidence route and handling rules. The work needs clear purposes, relevant system boundaries and suitable specialist participation. Controlled or sanitised examples should be used where possible, with raw sensitive material retained only in approved systems and access limited to the agreed scope.

Useful starting material would include functional and privacy requirements; architecture and provider options; access, retention and recovery constraints. These inputs have different jobs: the first establishes context, the second supplies behaviour or comparison material, and the third exposes operating conditions that may qualify a conclusion. Existing material would be reviewed before requesting new collection, and a missing input would be recorded as an evidence gap rather than treated as a favourable result.

How the work proceeds

Translate approved privacy requirements into observable checks

Follow the evidence through the work

  1. Functional and privacy requirements

    Map the approved processing purpose and scoped information path.

  2. Architecture and provider options

    Examine this material under the data owner’s handling rules.

  3. Centralized convenience

    Challenge this distinction using an authorised, bounded case.

  4. A privacy validation and implementation backlog

    Separate technical findings from questions requiring qualified legal review.

The sequence is adapted to the system, decision and authorised access.

Map the privacy question

Translate privacy objectives into explicit data and control requirements. The opening step turns the operating concern into a question that can be examined. It would identify a data and control boundary across collection, processing, storage and tool execution, the outcome the owner cares about and the conditions that would make an observation decision-relevant. Scope changes would remain explicit if the evidence reveals a different problem.

Define observable criteria

Compare processing locations, interfaces and storage boundaries. The comparison material would include architecture and provider options, with access, retention and recovery constraints available to explain the operating conditions. Differences between privacy policy and enforced architecture would remain visible beside the observation rather than disappear into a pooled result.

Examine the relevant paths

Design minimum necessary access and lifecycle controls for the workflow. The review question would explicitly distinguish centralized convenience from exposure boundary. A material discrepancy would be traced back to functional and privacy requirements and the relevant execution or decision record, so a proposed change addresses the observed cause rather than the most convenient explanation.

Review findings and limits

Define validation evidence and unresolved legal or provider dependencies. The resulting privacy validation and implementation backlog would explain the distinction between data availability and necessary use and identify what further observation would change the recommendation. The privacy and product owner would retain the decision, including whether a narrower scope or a different approach is preferable.

Indicative artefacts

Use a privacy validation and implementation backlog to make the next action explicit

Every artefact needs an operating use

Illustrative working format

Scope and definitionsA privacy architecture decision record
Boundary — functional and privacy requirements.
Findings and limitsA data and enforcement boundary design
Findings about centralized convenience.
Decision and follow-upA privacy validation and implementation backlog
Action on data availability.
Illustrative fields; no prior delivery implied.

The final artefact set depends on the agreed decision. Useful outputs can include:

  • A privacy architecture decision record. The working foundation for the question, including relevant definitions, boundaries and assumptions so another reviewer can understand what was examined.
  • A data and enforcement boundary design. The substantive observations and interpretation, preserving adverse results, disagreement and limitations that affect how the evidence may be used.
  • A privacy validation and implementation backlog. The connection to action: what the owner could do next, what evidence is still missing and what change would justify revisiting the conclusion.

Scope and authority

Technical findings need separate legal and processing decisions

Keep analytical work separate from decision authority

Within the reviewApproved processing paths and technical checks
Can include a privacy architecture decision record.
Retained authorityPrivacy and data owner
Qualified legal and privacy owners interpret requirements and approve processing.
Outside this evidenceLegal determinations or guaranteed privacy
Cannot be inferred from a data and enforcement boundary design.
Technical privacy findings do not determine lawful processing, authorise transfers or certify compliance.

This is a proposed technical and operational privacy scope. It does not determine lawful processing, approve transfers, certify compliance or guarantee that information cannot be disclosed. Qualified privacy, legal and security review would be arranged where the actual processing or test methods require it. To discuss privacy-by-design architecture, the first practical step is to identify the relevant owner and bring a sanitised description of the decision, the current alternative and the material uncertainty. That gives scoping a concrete starting point without implying a preapproved package or favourable conclusion.

Ways to engage

Related engagement scopes

AI Agent Component Evaluation

Find where agent behaviour breaks down. Follow memory, retrieval and delegation through your workflow, then isolate the components that need attention.

Read about this offer: AI Agent Component Evaluation

AI Agent Memory Assurance

Examine what your agent remembers, when it retrieves it and whose information it can expose—in the deployment where it actually works.

Read about this offer: AI Agent Memory Assurance

AI Privacy Engineering Review

Trace personal data through your agent workflow. Examine collection, memory, retrieval, tool access and retention against your agreed requirements.

Read about this offer: AI Privacy Engineering Review

Continue exploring

Related insights and resources

Whitepaper15 MIN READ

Protecting agent data and memory

An agent's information footprint extends beyond the conversation. Map the copies, derived records and retrieval paths that influence future actions, then connect each to purpose, access, retention and verifiable handling.

Evaluation & assurance5 MIN READ

Your agent passed the test. What does that prove?

A release decision needs a traceable connection between expected behaviour, test conditions and observed results. Here is a practical way to build that connection.

A little more clarity

Questions to consider.

Start with the questions that shape a better decision.

Does privacy by design mean storing everything locally?

No particular hosting pattern is assumed. The appropriate design depends on the task, data, access, provider behaviour and operating constraints. Local processing may address some exposure paths while leaving purpose, retention, identity and output questions unresolved.

Can the work fit an existing architecture?

Yes. The proposed review can focus on a material change or specific data boundary. It would identify feasible modifications and tradeoffs while preserving useful existing controls, rather than requiring a complete system redesign without evidence of need.

Where should privacy enforcement sit?

At the relevant data and action boundaries, with roles and failure behaviour defined. Prompt instructions can express intent but should not be the sole evidence for enforcement.

How should architecture tradeoffs be recorded?

State which exposure each option addresses, what task or operational cost it introduces and what remains unresolved. The decision should preserve rejected options and their rationale.

Can privacy controls impair task quality?

The proposed design would test that possibility explicitly. Reduced context or access may require workflow changes, and the resulting tradeoff needs evidence rather than assumptions.

What would make the privacy engineering findings usable for our decision?

The findings should explain the distinction between data availability and necessary use and connect observations to the agreed criteria. An accountable owner should be able to identify what is supported, what remains uncertain and which follow-up would change the decision. The actual scope and review arrangement would be agreed before work begins.

Start with the decision you need to make.

Tell us about the agent workflow you want reviewed, and where you need greater clarity. Scope and availability are confirmed together.

Connected disciplines