- In short
- A production failure should be classified into one of four categories, each with a different fix. Prompt failure: an ambiguous or underspecified instruction let the model fill the gap incorrectly, fixed in the prompt. Hallucination: confident, fluent content not grounded in the input or a reliable source, fixed by grounding through retrieval, tool use, or verification, not stronger instructions. Model mismatch: the tier is wrong for the task or was swapped without re-evaluation, fixed by eval-gated model selection. Orchestrator-workers failure: requires tracing across the orchestrator and its subagents to distinguish a recoverable subagent failure from an unrecoverable orchestrator failure.
Full concept guide coming soon
We are building the in-depth, exam-aligned guide for this knowledge point. In the meantime, explore the prerequisites and related concepts below, watch the official Anthropic Academy lessons, and start an adaptive study session to master it with Archie.
Watch and learn
Official Anthropic Academy lessons first, then hand-picked walkthroughs. Videos load only when you press play.
No videos curated for this concept yet
We are still curating the best official and community videos for this topic.
References & primary sources
Adaptive study
Master this concept with Archie
Practice it inside an adaptive study session. Archie, your Socratic AI tutor, tracks your mastery with Bayesian Knowledge Tracing and schedules the perfect next review.