- In short
- The three eval methodologies are code-based, model-based, and human-review. Code-based evals run deterministic checks such as schema validation, regex, or exact match in milliseconds at near-zero cost. Model-based (LLM-as-judge) evals score outputs that require interpretation, such as tone or reasoning quality, at roughly the cost of a model call per item. Human-review evals rely on human judgment for high-stakes or novel behaviours and are the slowest and most expensive. Behaviours with a single unambiguous correct answer suit code-based checks; behaviours requiring interpretation suit model-based or human evals.
Full concept guide coming soon
We are building the in-depth, exam-aligned guide for this knowledge point. In the meantime, explore the prerequisites and related concepts below, watch the official Anthropic Academy lessons, and start an adaptive study session to master it with Archie.
Watch and learn
Official Anthropic Academy lessons first, then hand-picked walkthroughs. Videos load only when you press play.
No videos curated for this concept yet
We are still curating the best official and community videos for this topic.
References & primary sources
Adaptive study
Master this concept with Archie
Practice it inside an adaptive study session. Archie, your Socratic AI tutor, tracks your mastery with Bayesian Knowledge Tracing and schedules the perfect next review.