Output Evaluation and Validation·Task 2.2·Bloom: understand·Difficulty 2/5·8 min read·Updated 2026-07-14

The Precision-Without-Source Signal for Fabricated Specifics

Identify hallucinations, inconsistencies, and biases in responses

SUBy Solomon UdohReviewed by Solomon UdohAI-assisted · human-reviewed
In short
The precision-without-source signal uses the presence of a precise, uncited figure as the practical tell for a fabricated statistic. Genuine statistics of that precision are ordinarily accompanied by a traceable citation, so a suspiciously exact number with no source attached is a warning sign, not evidence of rigour. Checking for a citation is a faster first-pass filter than independently verifying the number.

A fast filter for a slow problem

Verifying a statistic from scratch is expensive; you have to find the real number and confirm it. The Claude Certified Associate - Foundations (CCAO-F) exam teaches a cheaper first-pass filter for the specific case of fabricated figures: look at whether the precise number carries a source. This turns the fabricated-specific pattern from the general taxonomy into a concrete, repeatable check you can run in seconds before deciding whether a slower verification is even needed.

The insight is about how real statistics behave in the wild. A figure precise enough to be quoted to a decimal place almost always came from somewhere specific, and in professional writing it is reported with that somewhere attached. So the presence of precision with the absence of a source is an anomaly, and anomalies are exactly what a first-pass filter should flag.

The precision-without-source signal
A practical tell for fabricated statistics: treat a precise, uncited figure as a warning sign. Genuine statistics of that specificity ordinarily arrive with a traceable citation, so precision plus no source means the specificity is persuading you without evidence. Checking for a citation is a faster first-pass filter than independently re-deriving the number.

Why precision plus no source is the tell

Precision reads as authority. A statement that "roughly a majority" of firms did something invites scrutiny; a statement that "63.4 percent" of firms did it feels settled. That psychological weight is precisely why fabricated specifics are dangerous, and precisely why the missing source matters. When a figure is that exact, the reader's instinct is to trust it, so the one thing that would let the reader check it, the citation, is the thing most worth demanding. Its absence, next to that much precision, is the signature of a number-shaped guess rather than a reported fact.

The citation check comes before verification

The reason this is a filter and not the whole job is efficiency. Independently verifying a number means research; checking whether a citation is even attached takes a glance. Running the glance first triages your effort: figures that arrive with a genuine, traceable source can be spot-checked, and figures that arrive precise but uncited are flagged for either a demand-for-source re-prompt or removal. You do the expensive verification only where the cheap filter says you must, and you never let a precise-but-uncited figure through on the strength of its precision alone.

precise
an exact figure invites trust it has not earned
uncited
no source attached is the anomaly to flag
filter first
checking for a citation is faster than re-deriving the number

What the CCAO-F exam trips candidates on

The first trap is trusting a precise-sounding statistic more than a vague one, when the reverse caution is warranted without a source. The exam deliberately dresses a fabricated figure in extra precision to test whether you read that as rigour or as risk. The credited answer treats an uncited precise number as more suspicious than a hedged general one, because the precision is the persuasion, not the proof.

The second trap is accepting a citation that exists in name but cannot actually be located or opened as sufficient grounding. The filter is only satisfied by a source you can trace, not by a source-shaped string of text. A reference that looks like a citation but leads nowhere is itself a fabricated specific in the format of rigour, which is developed further in auditable versus untraceable citations.

Worked example

A Claude-drafted market overview states: 'The addressable market reached $2.6 billion in 2025 (industry estimates), growing 14.2 percent year over year.' A colleague says the parenthetical 'industry estimates' makes it safe to cite. How do you apply the precision-without-source signal?

Start with the two precise figures: $2.6 billion and 14.2 percent year over year. Both are exact enough that, if real, they came from a specific report and would normally be reported with that report named. So the precision-without-source signal is already primed; the only question is whether a genuine, traceable source is attached.

The parenthetical "industry estimates" is not that source. It is a citation-shaped phrase with nothing behind it: no named report, no publisher, no date, nothing a reviewer could open and check. That is the second trap in action, treating a source-shaped string as if it were a source. Functionally, these figures are still precise and uncited, which is the fabricated-specific signature, and the parenthetical adds an unearned air of rigour rather than removing the risk.

The right move is to run the cheap filter first and let it fail: because no traceable source exists, do not cite these numbers on their strength. Either re-prompt with an instruction to answer only from a named, checkable source and to flag anything unsupported, or drop the figures until a real citation can be produced. Only after a traceable source appears is the slower step, opening it and confirming it actually says $2.6 billion and 14.2 percent, worth your time.

Common misreadings to avoid

Misconception

A precise figure is more trustworthy than a vague one.

What's actually true

Without a source, a precise figure warrants more caution, not less. Precision reads as authority and makes a fabricated number more persuasive, so an exact, uncited figure is a warning sign rather than a mark of rigour.

Misconception

A citation-shaped phrase like '(industry estimates)' is enough to trust the number.

What's actually true

The filter is only satisfied by a source you can actually locate and open. A reference that looks like a citation but leads nowhere is a fabricated specific in the format of rigour, not grounding.

How this shows up on the exam

Domain 2 questions on this knowledge point present a precise figure and ask whether it can be trusted or what the risk is. The reliable move is to run the precision-without-source filter first: an exact number with no traceable citation is flagged as a likely fabricated specific, treated with more caution than a vague claim, and either re-grounded or verified before use.

This knowledge point sharpens the fabricated-specific signature from the hallucination pattern taxonomy into a concrete filter, and it hands off to auditable versus untraceable citations for what counts as a real source and to code execution for numeric verification for the numbers you must actually compute. It also feeds diagnosing failure patterns in outputs.

Check your understanding

A Claude output cites '(industry estimates)' beside a precise 14.2 percent growth figure, with no report named. What is the correct read?

People also ask

How do you spot a fabricated statistic in AI output?
Look for precision without a source. A suspiciously exact figure with no citation attached is the practical tell, because genuine statistics that specific normally come with a traceable source.
Why is a precise number without a source suspicious?
Real figures of that precision are usually reported with a citation. When the precision is present but the source is not, the specificity is doing persuasive work it has not earned, which is the fabricated-specific signature.
Should you trust a precise AI figure more than a vague one?
No. Without a source a precise figure warrants more caution, not less, because precision reads as authority and makes a fabricated number more persuasive. The specificity is what makes it convincing, not what makes it true.

Watch and learn

Official Anthropic Academy lessons first, then hand-picked walkthroughs. Videos load only when you press play.

No videos curated for this concept yet

We are still curating the best official and community videos for this topic.

Official prep for this domain

Anthropic's own free prep module for this part of the syllabus, on the official prep course. Free with an Anthropic Academy sign-in.

References & primary sources

Adaptive study

Master this concept with Archie

Practice it inside an adaptive study session. Archie, your Socratic AI tutor, tracks your mastery with Bayesian Knowledge Tracing and schedules the perfect next review.

Start studying