AI Impact Measurement Framework
Define what better should mean before scaling an agent. Connect quality, cost, adoption and business outcomes to a baseline your team can revisit.
Measure the workflow outcome after all relevant costs
- Baseline condition
- Document how the workflow performed before the change.
- Outcome definition
- Specify quality, completion and the comparison method.
- Human effort
- Include review, correction and adoption work.
- Value uncertainty
- Record operating costs, failure exposure and data limits.
Decision and fit
Measure the workflow outcome after all relevant costs
Compare the engagement with the decision you face
- A question worth resolving
- Measure the workflow outcome after all relevant costs.
- An accountable participant
- Business and finance owners deciding whether an agent initiative creates value after operating, oversight and change costs.
- Inspectable source material
- The relevant owners can make workflow evidence and agreed inputs available for examination.
- A scope mismatch
- The requirement is a guaranteed return figure without measurement data.
The engagement
Define what better should mean before scaling an agent. Connect quality, cost, adoption and business outcomes to a baseline your team can revisit. A measurement-design project with an optional first measurement cycle where sufficient baseline data exists.
The decision at stake
Agent programmes report adoption and activity, leadership asks what changed, and nobody can separate real outcome improvement from shifted effort, hidden review cost or risk that has not yet materialised.
Suitable situations
- Business and finance owners deciding whether an agent initiative creates value after operating, oversight and change costs.
- Teams launching an agent who want a baseline captured before behaviour changes.
- Organisations that need a consistent value model across several agent initiatives.
Less suitable situations
- Marketing claims or vendor comparisons; the framework is built for internal decision-making.
Engagement boundary
Agree the work and its boundaries together
The engagement boundary
- Baseline condition
- Baseline assessment of the workflows in scope, including cycle time, quality, effort and cost as they are today.
- Outcome definition
- The inputs, authorised access and client participants are confirmed before scheduling.
- Finance and workflow owners
- Retains organisational decisions and risk acceptance.
- Additional implementation
- The framework does not guarantee savings or attribute every change to AI. Repeated measurement, dashboard implementation and business-case updates require a separate scope or client-owned operating process.
What the work covers
- Baseline assessment of the workflows in scope, including cycle time, quality, effort and cost as they are today.
- Outcome metrics tied to workflow results rather than agent activity.
- Adjustments for operating cost, human correction and review effort, failure cost and exposure, and adoption friction.
- Value model and measurement plan, including data sources, cadence and ownership.
- Dashboard and reporting design suitable for steering and finance review.
Scope boundaries
- Revenue or savings guarantees, and figures presented without their method and uncertainty.
- Building analytics infrastructure, unless separately agreed.
- The framework does not guarantee savings or attribute every change to AI. Repeated measurement, dashboard implementation and business-case updates require a separate scope or client-owned operating process.
Working sequence
How the work moves from question to handover
What each stage should leave your team with
- Agree what value means
Agreed outcome definitions and comparison assumptions
- Capture the baseline
A documented baseline with sources and quality limits
- Define metrics and the model
An explicit account of correction, review and operating costs.
- Plan measurement
Measurement ownership, calculation rules and review cadence.
- Report and calibrate
A reporting design usable by business and finance owners.
How the work proceeds
- Agree what value means. Work with sponsors and finance to define the outcomes that matter and the costs that must be netted against them.
- Capture the baseline. Measure the current workflow before the agent changes behaviour, and document the method so it can be repeated.
- Define metrics and the model. Specify outcome metrics, the adjustments, and how they combine into a value statement with stated uncertainty.
- Plan measurement. Identify data sources, instrumentation needs, owners and cadence, and the conditions under which conclusions can be drawn.
- Report and calibrate. Design the reporting, run a first cycle where possible, and adjust the model against what the data can actually support.
Decision artefacts
Leave a record the next owner can use
Value model entry
Illustrative working format
- Subject and version
- Identify the workflow, configuration or proposal examined.
- Baseline condition
- Record the relevant requirement and supporting material.
- Human effort
- State the observation, supporting evidence and remaining uncertainty.
- Finance and workflow owners
- Record the next decision, follow-up and unresolved question.
What the work can produce
- Baseline report for the workflows in scope, with method and limitations recorded.
- Metric definitions and the value model, including how each adjustment is calculated.
- Measurement plan with data sources, owners and cadence.
- Reporting design, and where agreed, a first measurement cycle.
Worked situation
Follow one situation through to a bounded next decision
Illustrative working situation
Illustrative scenario
- Starting condition
Agent completions rise while reviewers spend longer correcting work.
- Question to examine
Compare quality-adjusted outcomes with total human effort.
- Possible next action
Report the supported value range and remaining measurement gaps.
Engagement notes
Read the detailed engagement considerations
How the detailed notes connect
- Baseline condition
- Document how the workflow performed before the change.
- Outcome definition
- Specify quality, completion and the comparison method.
- Human effort
- Include review, correction and adoption work.
Why activity is not impact
Agents generate messages, actions and completions at low marginal cost, so activity metrics rise almost by definition. Impact requires a comparison with what would have happened otherwise, and an accounting of the costs the agent introduces: the reviews people now perform, the corrections they make, the failures that reach customers, and the effort of adopting new ways of working. The framework treats each of these as a line in the model rather than a footnote.
Stating uncertainty
Every figure in the value model carries a method and a confidence. Where the data does not support a conclusion, the report says so. This is deliberately conservative: a value statement a finance function trusts is worth more than a larger one it discounts.
Working together
Your team and our team need a clear working agreement
Who contributes and who decides
- Client sponsor
- Confirms the decision, priorities and people needed to resolve it.
- Client technical or process owner
- Provides the agreed evidence, access and review of findings or deliverables.
- Softlander delivery lead
- Coordinates the agreed activities, review points, handover and open actions.
- Authorised decision-maker
- Accepts deliverables against the agreed criteria and separately decides operational or business action.
What the work depends on
- A process owner, finance partner and data owner supply baseline workflow measures, cost definitions, adoption information and access to the agreed observations. They validate which comparisons are fair and which effects cannot be isolated.
- Access to workflow data and the people who understand it.
- Finance involvement in defining cost and value treatment.
- Instrumentation in the agent and surrounding systems, or agreement to add it.
Engagement availability
The start date, named delivery roles, review points and fee basis are agreed after confirming the inputs and scope. Duration depends on evidence access, system complexity and the time your decision-makers need to review the work.
Engagement and handover
Agree the delivery model and what completion means
A clear agreement from scope to ownership
- Scoped work
- Baseline assessment of the workflows in scope, including cycle time, quality, effort and cost as they are today.
- Indicative handover
- Baseline report for the workflows in scope, with method and limitations recorded; Metric definitions and the value model, including how each adjustment is calculated.
- Review and acceptance
- Review the agreed deliverables and record any open items, owners and conditions.
- Ongoing work
- Assign maintenance and operational ownership; agree additional scope and coverage explicitly.
A measurement-design project with an optional first measurement cycle where sufficient baseline data exists.
The measurement plan defines each metric, source, owner and calculation, including correction and oversight effort. Finance and business owners can reproduce a sample calculation and understand uncertainty before using the model for investment decisions.
The framework does not guarantee savings or attribute every change to AI. Repeated measurement, dashboard implementation and business-case updates require a separate scope or client-owned operating process.