Strategy & transformation6 MIN READ
What a polished agent demo does not tell you
A demonstration shows one possible path. A buying decision needs evidence about representative work, failure, authority, recovery and operation.
THE SOFTLANDER BLOG
Evaluation evidence
Tests, observations and decision records that show how an agent behaves under relevant conditions.
In Evaluation evidence
31 articlesEvaluation & assurance6 MIN READ
How to design an independent agent benchmark that remains useful
A durable agent benchmark needs a declared construct, protected cases, reproducible execution, uncertainty, governance and limits on the claims its scores can support.
Evaluation & assurance6 MIN READ
Design agent evaluations backwards from the decision
Start with the choice an owner must make, then derive claims, evidence, cases and measures. The result is smaller, sharper and easier to defend.
Governance & privacy7 MIN READ
How to build an evidence register for an AI system
An evidence register should connect each claim and requirement to versioned artefacts, review decisions, known gaps and the conditions under which evidence expires.
Governance & privacy6 MIN READ
How audit committees can discuss AI without pretending to be engineers
Audit committees can oversee AI through ownership, control evidence, reporting integrity and assurance scope without turning meetings into model-architecture tutorials.
Governance & privacy7 MIN READ
Turning AI governance principles into executable controls
A principle becomes operational only when it is translated into requirements, control owners, enforcement points, evidence and responses to failure.
Architecture & engineering6 MIN READ
The foundation model is only one dependency in an agentic system
Model selection matters, but production behaviour emerges from an entire dependency graph. Review the system that turns model output into business effects.
KEEP EXPLORING
Take the thinking
into your next discussion.
Read the method, assumptions and questions to ask.