Who owns an AI agent after launch?

Live agents cut across product, operations, risk and technology. One accountable service owner needs explicit decision rights supported by named control owners.

Categories: Governance & privacy, Strategy & transformation Series: Agentic transformation

Before launch, an AI agent belongs to a project. After launch, it belongs to a workflow—and project governance is no longer enough.

The live system makes or supports decisions, reads changing data, calls external services, affects employees or customers, consumes budget and creates incidents. Product, engineering, operations, security, privacy, legal, data and business teams all have legitimate responsibilities. When that shared responsibility is not translated into decision rights, the agent becomes everybody’s concern and nobody’s service.

The answer is not to make one person perform every role. It is to name one accountable workflow owner and connect that owner to a control system whose decisions are explicit.

Give one owner the whole workflow outcome

The accountable owner should own the service outcome the agent changes, not merely the model or interface. For a support-resolution agent, that may include resolution quality, customer effort, operational capacity, authorised concessions and unresolved cases. For a procurement assistant, it may include recommendation quality and review efficiency, while purchasing authority remains elsewhere.

The owner needs power to:

  • set and narrow the intended purpose;
  • prioritise changes and remediation;
  • accept or reject residual operational risk within delegated authority;
  • allocate operating capacity;
  • decide whether evidence supports expansion;
  • suspend normal use when conditions change; and
  • recommend retirement or replacement.

NIST’s AI RMF calls for clear roles and communication, executive responsibility for AI risk decisions, ongoing monitoring and safe decommissioning (AI RMF Core). Those requirements point to lifecycle ownership, not a handoff from project team to a generic support queue.

Separate accountability from specialist control ownership

Use an ownership map with one accountable owner and several control owners:

Ownership Decisions and evidence
Workflow or service purpose, scope, outcome, priority, continuation
Domain policy valid rules, exceptions, required judgement, approvals
Data authoritative sources, quality, access, retention, correction
Technology architecture, change, resilience, recovery, supplier operation
Identity and security principals, permissions, threats, credential lifecycle
Privacy and impact purpose boundaries, affected groups, mitigations, redress
Evaluation cases, measures, graders, evidence validity, regression
Operations monitoring, queues, handoff, incident response, support
Commercial contract, usage, concentration, exit and supplier changes

NIST’s AI actor-task descriptions identify distinct design, development, deployment, operation, evaluation, impact and governance contributions. Use those distinctions to prevent the model team from implicitly inheriting decisions that require business or fiduciary authority.

Define decisions, not just boxes on an org chart

A RACI chart can show involvement while leaving the most important question unanswered: who decides? Build a decision-rights register for recurring and exceptional events.

For each decision, record:

  • trigger and required response time;
  • accountable decider and delegate;
  • consulted specialists;
  • evidence required;
  • authority limit;
  • possible outcomes;
  • escalation and appeal route; and
  • record that proves the decision occurred.

Include at least these decisions: approve initial release, change a model or prompt, add a tool, widen data access, expand the user group, change an evaluation threshold, accept an exception, respond to an incident, resume after suspension, retire the service and communicate a material impact.

The register should reflect real time pressure. If a security operator detects unexpected data egress at 02:00, they need authority to disable the relevant tool immediately. The workflow owner can later decide whether service should resume. Containment and continuation are different decisions.

Keep product and operations together

An agent changes after launch even when its application code does not. Provider models, retrieval corpora, upstream policies, user behaviour, threat patterns and connected APIs evolve. Ownership therefore needs a standing product-and-operations rhythm.

The GOV.UK service-team guidance expects multidisciplinary capability to grow from discovery through live operation, including product, delivery, research, design, development, architecture, operations, quality and security. An agent service needs a similarly durable team or clearly contracted access to those functions.

At an agreed cadence, review:

  • outcome and control performance;
  • overrides, escalations and abandoned cases;
  • incidents and near misses;
  • data-quality and source changes;
  • model, prompt, tool and policy versions;
  • user and affected-party feedback;
  • operating cost and capacity;
  • open risks and expiring exceptions; and
  • proposed scope changes.

The meeting is not the control. The decisions, owners, due dates and evidence updates are.

Give the owner a small service ledger that connects those reviews over time. It should contain current purpose and boundary, active versions, material dependencies, approved exceptions, unresolved incidents, performance thresholds and the last continuation decision. The ledger does not need to duplicate technical telemetry or risk registers; it should point to authoritative records. Its value is continuity. A new owner can see which assumptions still govern operation, and a reviewer can distinguish an accepted condition from an issue that has simply remained open.

Make the human role operationally credible

“The user remains accountable” is often used to close an ownership gap. It is credible only if the person has enough information, competence, time and authority to challenge the agent.

NIST’s guidance on human–AI interaction notes that human roles must be differentiated and that outcomes vary across configurations. Define whether each person initiates, supervises, approves, receives, audits or handles exceptions. Do not make an employee the moral backstop for a system whose design, workload and incentives make review superficial.

Track whether review actually changes outcomes: overrides, corrections, escalations, time spent, evidence consulted and cases returned. A low override rate can mean high quality, automation bias or a powerless reviewer. Investigate rather than celebrate automatically.

Establish an incident command path

Every live agent needs an incident path spanning technical and business consequence. Define severity using what happened in the workflow: unauthorised action, sensitive disclosure, incorrect commitment, systemic quality degradation, inaccessible service or accumulating unresolved work.

The path should identify:

  1. who can detect and declare an incident;
  2. who can contain tools, credentials or traffic;
  3. who determines affected records and people;
  4. who owns required notifications and specialist advice;
  5. who reconciles external state;
  6. who approves restoration; and
  7. who turns findings into evaluation and control changes.

GAO’s accountability framework connects governance and data practices with performance and monitoring (GAO). Incident ownership is where those parts meet: telemetry has little value if nobody can translate it into a business response.

Preserve ownership through supplier and personnel changes

Vendor management does not transfer accountability for the workflow. Record supplier responsibilities, service levels, change notification, evidence access, incident cooperation, data handling and exit arrangements. Know how the enterprise can disable the service, export necessary records and continue critical work if the supplier changes terms or capability.

Likewise, assign roles rather than relying on named enthusiasts. Maintain deputies, handover material, runbooks and decision history. Test that a new operator can understand current scope, active risks and unresolved states without asking the original project team to reconstruct them.

Use a one-page ownership test before release

A launch decision should be able to answer:

  • Who owns the workflow outcome?
  • Who owns each critical control?
  • Who can authorise scope and authority changes?
  • Who watches live evidence, and how often?
  • Who can stop action immediately?
  • Who decides to resume?
  • Who handles affected people and unresolved cases?
  • Who funds maintenance, evaluation and support?
  • Who retires the agent and preserves required records?

If the answers are committees without named decision rights, the service is not owned. Launching an agent does not create accountability; it exposes whether the organisation has designed it.

Get the agent release checklist

Working through this decision?

Turn diffuse responsibility into explicit decision rights, operating controls and review cadence.

A little more clarity

Questions worth asking.

Start with the questions that shape a better decision.

Should IT own every AI agent?

IT may own the platform and technical operation, but the business owner of the changed workflow should remain accountable for purpose, scope, outcomes and continuation.

Is a RACI enough for live-agent ownership?

It is a useful start, but each consequential decision also needs a named decider, trigger, required evidence, escalation route and time expectation.

Who can stop an AI agent?

Define both emergency operators who can contain immediate harm and an accountable owner who decides whether and under what conditions service resumes.