Independent verifier systems

Definition

A separation-of-judgment architecture in which builder agents, evaluator agents, deterministic checks, domain experts, and authorization authorities challenge different failure surfaces. A builder can test its work. It cannot independently accept the risk created by its work.

Independent assurance is established; multi-agent implementations remain experimental.

Why it matters

A builder can test its work. It cannot independently accept the risk created by its work.

The operating shift is from “Self-review before merge” to “Independent challenge across the lifecycle.”

System anatomy

Practice 1

Separate builder and verifier context

Practice 2

Use heterogeneous verification methods

Practice 3

Route unresolved disagreement to accountable humans

Important distinctions

Self-review before merge

This concept moves the engineering system toward independent challenge across the lifecycle.

Implementation signals

• Separate builder and verifier context
• Use heterogeneous verification methods
• Route unresolved disagreement to accountable humans

Failure modes

• Multiple agents sharing the same blind spot
• Model graders treated as independent authorities

Sources and further study

1. Anthropic — Harness design for long-running application development

   A planner, generator, and evaluator architecture for multi-hour autonomous application development.

   Use in this library: First-party case study. This first-party account documents one organization, product, or implementation context and should not be generalized without local evidence.

   engineering · engineering · Published 2026-03-24
2. Anthropic — Demystifying evals for AI agents

   A practical treatment of evaluating trajectories, outcomes, graders, tasks, and agent-environment interaction.

   Use in this library: Official guidance. This is first-party engineering guidance drawn from Anthropic deployments. Evaluation designs remain task- and environment-specific, and the article does not establish independent verifier ownership by itself.

   engineering · engineering · Published 2026-01-09
3. NIST — Towards best practices for automated benchmark evaluations

   Guidance on the integrity and limitations of automated benchmark evaluation practices.

   Use in this library: Official guidance. Guidance describes recommended practice; citation does not prove that a control is implemented or effective in a particular environment.

   guidance · guidance · Published 2026-01-30