- In short
- When an iteration round reveals a numeric error rather than a stylistic one, the fix is to add an instruction to use a verifiable computation method, such as code execution, rather than iterating on wording. A wrong number is usually a computation problem, not a phrasing problem, and constraining Claude to a verifiable calculation method reduces the chance of an unverified estimate being presented as fact. Re-running the same unconstrained calculation and averaging the results does not fix an unreliable method.
Some gaps are numeric, not stylistic
Most iteration signals point to a wording component - context, task, constraint, format. But one class of deficiency does not, and the Claude Certified Associate - Foundations (CCAO-F) exam singles it out: a wrong number. When an iteration round reveals that the content and phrasing are fine but a calculated figure is off, the diagnosis is different in kind. This is an apply-level skill because the correct fix - constrain the computation to a verifiable method - is not the same family of move as the wording edits that fix every other signal.
The reframe is simple but easy to miss under the momentum of an iteration loop. You have been reading outputs and adjusting components, so the reflex is to adjust another component. But a wrong average or a miscalculated total is not a tone problem or a length problem; it is a computation problem. Treating it as wording sends you iterating on the wrong thing entirely while the number stays wrong.
- Verification tools for numeric accuracy
- When an iteration round reveals a numeric error rather than a stylistic one, adding an instruction to use a verifiable computation method - such as code execution - rather than iterating on wording. A wrong number is usually a computation problem, not a phrasing problem, and constraining Claude to a verifiable calculation method reduces the chance of an unverified estimate being presented as fact. Re-running the same unconstrained calculation and averaging does not fix an unreliable method.
A wrong number is a computation problem
The core insight is that the type of deficiency determines the type of fix. A generic output is fixed with context; a wrong-shaped output is fixed with a format; a wrong number is fixed with a reliable calculation method. When Claude produces a figure as part of a prose answer without a verifiable computation behind it, that figure can be a confident-looking estimate rather than a checked result - and confidence is not accuracy.
The fix is to constrain the calculation itself. Adding an instruction to compute the figure with a verifiable method, such as code execution, means the number comes from an actual calculation you can trust rather than from an unverified estimate. This directly reduces the risk of an unverified figure being presented as if it were fact. The move is targeted, in the spirit of the whole iteration discipline: you identified that the numeric component failed, so you change how the number is produced - not the tone, not the length, not the framing around it.
Repetition is not verification
The exam is pointed about one seductive non-fix: re-running the same unconstrained calculation several times and averaging the results. This feels rigorous - more samples, an average, surely more reliable? It is not. If the underlying method is unreliable, every run is an unreliable estimate, and averaging several unreliable estimates yields another unreliable estimate. You have added effort without adding verification, because the flawed method was never replaced.
Verification means changing the method to one that is actually trustworthy, not repeating a shaky one and smoothing the outputs. Code execution verifies because the arithmetic is genuinely performed; averaging three prose estimates verifies nothing because none of the three was ever performed. Recognising this distinction - between a verifiable method and mere repetition - is exactly what separates the credited answer from the plausible distractor on this knowledge point.
What the CCAO-F exam trips candidates on
Two traps recur, and both misfile a numeric error.
The first is treating a wrong calculated figure as a prompt-wording issue and iterating on tone or length instead of the calculation method. A scenario shows accurate prose with a bad number and a distractor that adjusts the phrasing. The credited reading is that the number is a computation problem - the fix is to constrain Claude to a verifiable method like code execution, not to re-word anything.
The second is assuming that repeating the same flawed approach several times and averaging the outputs is equivalent to verification. A scenario runs the unconstrained calculation three times and averages, presenting that as diligence. The reliable reading is that averaging unreliable estimates produces another unreliable estimate; only switching to a verifiable method actually addresses the accuracy of the figure.
Worked example
A prompt asks Claude to 'calculate the average deal size from this list and summarise the trend.' The summary reads well, but the average looks wrong. A colleague suggests either rewording the prompt to be clearer or having Claude recompute the average three times and average those. What is the right fix?
Start by classifying the deficiency. The summary reads well, so the wording components - task, tone, format - are working. The only thing wrong is the number, and a wrong number is a computation problem, not a phrasing one. That immediately rules out the reword suggestion: sharpening the language will not make an unverified arithmetic result correct, because the language was never the issue. Iterating on wording here is iterating on the wrong component.
The recompute-and-average suggestion is the more tempting trap, and it also fails. If Claude produced the average without a verifiable calculation the first time, running that same unconstrained approach three more times just yields three more unverified estimates, and averaging them produces yet another unverified estimate. Repetition is not verification. The correct fix is to change the method: add an instruction to compute the average using code execution, so the figure comes from an actual, checkable calculation rather than an estimate. That directly reduces the chance of a confident-but-wrong number being presented as fact. The lesson the exam draws is to match the fix to the type of deficiency - numeric errors call for a verifiable computation method, not for rewording and not for averaging a shaky one.
Common misreadings to avoid
Misconception
A wrong number in the output means the prompt wording needs sharpening.
What's actually true
Misconception
Running the calculation several times and averaging the results is a good way to verify it.
What's actually true
How this shows up on the exam
Domain 1 questions on this knowledge point present an output whose prose is fine but whose number is wrong, and offer wording edits or repeat-and-average as tempting fixes. The reliable choice is to constrain the calculation to a verifiable method such as code execution, on the principle that a numeric error is a computation problem and repetition is not verification.
This knowledge point extends output deficiencies as diagnostic signals to a deficiency that is numeric rather than stylistic, and it sits within the discipline of running a multi-round diagnose-and-fix cycle. It also connects to source discipline in calibrating research prompts and source discipline, where the same instinct - do not trust a confident-looking claim without a verifiable basis - applies to citations.
Claude's output correctly summarises a dataset's trend but reports a total that appears miscalculated. Which fix best addresses the error?
People also ask
Is a wrong number a wording problem?
Does running a calculation several times and averaging help?
When should I use code execution in a prompt?
Watch and learn
Official Anthropic Academy lessons first, then hand-picked walkthroughs. Videos load only when you press play.
No videos curated for this concept yet
We are still curating the best official and community videos for this topic.
Official prep for this domain
Anthropic's own free prep module for this part of the syllabus, on the official prep course. Free with an Anthropic Academy sign-in.
References & primary sources
Master this concept with Archie
Practice it inside an adaptive study session. Archie, your Socratic AI tutor, tracks your mastery with Bayesian Knowledge Tracing and schedules the perfect next review.