AISDLC Insights

I08 · Operating thesis · 7 min read

Train the judgment, not the tool

Models and interfaces will keep changing. The durable capability is knowing what to delegate, how to bound it, what evidence to demand, and when a human must say no.

By AISDLC Editorial · Published 2026-08-11 · Reviewed 2026-08-11

Agentic-engineering programs are often organized around a tool menu: prompt features, model interfaces, framework syntax, and a demonstration that ends when the agent produces something plausible. Those skills can be useful, but they decay as products change. They also leave the central production question unanswered: can the practitioner decide what should be delegated, constrain how the work is performed, recognize when the result is unreliable, and assemble evidence that an independent reviewer can challenge?

Name the judgment the work requires

Judgment in this discipline is not a vague seniority trait. It is a set of observable decisions: selecting an outcome worth automating; decomposing it into bounded work; separating trusted instruction from untrusted data; choosing an execution envelope; assigning independent verifiers to material failure hypotheses; interpreting disagreement; and reserving release authority for a named human. Each decision can be stated, inspected, challenged, and improved.

Access to capable models is spreading, but access is not uniform and it does not erase differences in price, latency, privacy, context, or contractual terms. More importantly, model access alone does not supply an operating system for dependable work. DORA’s 2025 research frames AI as an amplifier of the engineering system in which it is introduced. It does not establish that a particular course, curriculum, or tool produces better outcomes. It does make the surrounding system—feedback quality, delivery practice, leadership, and organizational conditions—part of any serious adoption discussion.

Tool-familiarity training

  • Reproduce a demonstration
  • Memorize the current interface
  • Treat generated output as the endpoint
  • Use course completion as the success signal

Judgment-transfer practice

  • Bound a consequential decision
  • Explain the authority and context envelope
  • Produce an artifact another party can try to disprove
  • Use findings and dispositions as learning evidence

Make practice produce something challengeable

A field exercise becomes useful when it creates more than activity. It should state a driving question, constrain the work, name the expected artifact, identify an independent reviewer, define what that reviewer attempts to disprove, and specify what happens when the challenge succeeds. The learner is then practicing the same separation of construction, verification, evidence, and authority that a production lifecycle requires.

The evidence-first stage contract

A bounded question
State the decision or engineering problem before introducing a tool, model, or technique.
A reviewable artifact
Produce a manifest, threat model, evaluation set, control trace, decision record, or other object that persists beyond the exercise.
An independent challenge
Name a reviewer who did not produce the work and give that reviewer a concrete failure hypothesis to test.
A recorded disposition
Capture pass, fail, correction, hold, or escalation and the evidence that supports it; do not silently edit away the failed attempt.

Practitioner talks can help teams name emerging patterns and imagine new software interfaces. Andrej Karpathy’s “Software Is Changing (Again),” for example, is included here as a thought-leadership lens, not as empirical proof of a learning model. A source-disciplined curriculum keeps those roles visible: research supports only the claim it tested; operating guidance informs practice; practitioner experience supplies hypotheses; and the organization’s own artifacts and outcomes determine whether transfer occurred locally.

Completion is not standing

The AISDLC Field Curriculum is public reference material. Its four paths and twenty-six stages can structure individual study or team practice, but finishing a path does not certify a practitioner, prove that an exercise passed independent review, confer authority, or satisfy an enterprise gate. Any team adopting a path must route the resulting work through its own review, authorization, and recordkeeping system. That limitation is not a footnote; it is the lesson. In a governed lifecycle, a claim becomes dependable only when its evidence and decision authority are explicit.

Use a learning path as operating practice

A team can make the public curriculum useful without turning it into a credentialing system:

  • Choose one path that corresponds to a real capability gap, not the newest tool.
  • Run a small number of stages at a pace the assigned reviewers can genuinely challenge.
  • Store exercise artifacts and dispositions in the team’s own governed system of record.
  • Keep the producer and verifier separate; rotate roles without allowing self-approval.
  • Translate recurring findings into repository guidance, deterministic checks, verifier contracts, or control backlog items.
  • Evaluate transfer with multiple outcome and workload signals, and record where the evidence remains inconclusive.

Primary sources

  1. METR — Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
  2. Google Research / DORA — DORA 2025 State of AI-assisted Software Development Report
  3. Microsoft Research / ACM Queue — The SPACE of Developer Productivity: There's more to it than you think
  4. Andrej Karpathy — Software Is Changing (Again)

AISDLC Insights publishes source-informed editorial synthesis and implementation positions. It is reference material, not a standard, certification, legal opinion, or authorization to deploy an agent.