AISDLC Insights

I10 · Evidence and control · 6 min read

Deployment is an evidence decision

A working demonstration establishes possibility. A production release needs a specific case for the version being shipped, the authority it receives, and the conditions under which it must stop.

By AISDLC Editorial · Published 2026-09-06 · Reviewed 2026-09-09

The difficult moment in an AI deployment is the transfer from “we have seen this work” to “we are prepared to rely on this under these conditions.” A demo shows a selected interaction. A release transfers consequences to users, operators, and connected systems. The AI software development lifecycle needs a way to make that transfer explicit without turning every change into a months-long review.

Start by writing the release claim in operational terms. For example: this version can draft a service response from an approved knowledge collection, identify unsupported answers, and route uncertain cases to a person; it cannot send the response. That statement establishes a useful boundary for testing and rollout. “The agent is production-ready” leaves almost every meaningful question unanswered.

Make the thing being approved identifiable

An application commit alone may not describe an AI system’s behavior. A changed model, system instruction, retrieval collection, tool schema, or permission can alter its decisions while the interface remains identical. Keep a release manifest that identifies these dependencies at the level the environment permits. If a provider can change an unpinned dependency, record that limitation and decide what monitoring or regression checks compensate for it.

The manifest should link to the evaluation results, known limitations, owner, and rollout decision for that release. It should reference protected evidence where needed instead of copying sensitive prompts and user records into general-purpose logs. Its purpose is practical: during a regression, an engineer should be able to determine what changed and whether the earlier evidence still applies.

Build the evaluation around likely failure

A support drafting system may sound fluent while grounding its answer in an outdated policy. A workflow agent may report success after a downstream write failed. A coding agent may pass its own new tests while breaking a user permission boundary. The release case should name the failures that matter and show how they were challenged, including cases where the correct behavior is to decline, defer, or ask for a missing input.

A practical path from candidate to controlled release

  1. Define · State the permitted behavior Name the user, workflow, data boundary, allowed actions, expected result, and conditions that require intervention.
  2. Compare · Test the candidate against a baseline Use representative cases and consequential exceptions. Preserve per-case failures, variation across runs, latency, and cost rather than reporting only an average score.
  3. Rehearse · Exercise the operating response Demonstrate that alerts reach an owner and that access can be narrowed or the previous version restored. Identify effects that a software rollback cannot undo.
  4. Expose · Begin with a limited rollout Choose an initial cohort and action boundary appropriate to the workflow. Set explicit conditions for expansion, hold, and withdrawal before observing the results.

This is an implementation position, not a claim that one evaluation suite can prove universal safety. Deterministic checks, calibrated judgment, and live operational signals answer different questions. Select enough evidence for the consequences of the release, explain the gaps, and avoid making a high aggregate score stand in for untested behavior.

Keep the release case alive after launch

Make those changes inputs to the delivery backlog. A new tool permission should trigger a review of action boundaries. A revised knowledge collection should run the relevant grounded-answer cases. A material production failure should become a regression case and an incident learning record. The review should follow the changed assumption, so a small interface correction and an expanded ability to modify customer records receive proportionate scrutiny.

Before expanding the rollout

  • Can we identify the exact candidate and the evidence evaluated for it?
  • Have we inspected failures by workflow and consequence, including repeated trials where behavior varies?
  • Does the granted authority match the behavior that was tested?
  • Can the operating owner detect a material failure and stop further effects?
  • Are the signals for continuing, pausing, or reversing the rollout agreed and visible?
  • Which change in the model, context, tools, or environment would require a new release decision?

Primary sources

  1. Anthropic — Demystifying evals for AI agents
  2. SLSA — SLSA provenance specification v1.2
  3. Microsoft Agentic Center of Excellence — Manage the agent lifecycle

AISDLC Insights publishes source-informed editorial synthesis and implementation positions. It is reference material, not a standard, certification, legal opinion, or authorization to deploy an agent.