Output Evaluation and Validation·Task 2.2·Bloom: remember·Difficulty 1/5·5 min read·Updated 2026-07-14

The Three Signatures of AI Hallucination

Identify hallucinations, inconsistencies, and biases in responses

SUBy Solomon UdohReviewed by Solomon UdohAI-assisted · human-reviewed
In short
The hallucination taxonomy names three signatures of AI-generated inaccuracy: plausible-but-unsupported claims that sound reasonable but have no basis in fact or source, fabricated specifics such as invented statistics, dates, names, or citations that read as authoritative because they are precise, and confident tone that does not track actual certainty. Fluent writing quality is not a reliable indicator of correctness for any of the three.

Why you need named patterns

Plausible is not the same as verified. Claude writes fluently whether it is right or wrong, so you cannot lean on tone or confidence to flag an error. The Claude Certified Associate - Foundations (CCAO-F) exam responds to this by teaching the specific signatures of failure, so that you can spot them quickly instead of reading every line with equal, exhausting suspicion. Knowing the pattern is what turns a vague unease into a targeted check.

There are three hallucination signatures to recognise. They are not degrees of the same thing; they are distinct shapes that a fabricated or ungrounded claim can take, each with its own tell. Learning them by name is the first step toward catching them in the wild.

Hallucination pattern taxonomy
Three named signatures of AI-generated inaccuracy: (1) plausible-but-unsupported claims, which sound reasonable but have no basis in fact or source; (2) fabricated specifics, invented statistics, dates, names, quotations, or citations that read as authoritative because they are precise; and (3) confident tone masking uncertainty, where a guess and a grounded fact are delivered in the same assured voice. Fluency does not indicate correctness for any of them.

Plausible-but-unsupported claims

The first and most dangerous pattern is a statement that sounds reasonable, fits the topic perfectly, and has no basis in the source you provided or in fact. Nothing about it looks wrong, because it was generated to fit, not to be true. There is no jarring detail to catch your eye, no obvious error to trip over. This is why it is the hardest of the three: the only reliable defence is checking the claim against a reference rather than waiting for it to feel off.

Fabricated specifics

The second pattern is invented detail presented with precision: a statistic, a date, a name, a quotation, a citation. Specificity reads as authority, which is exactly why fabricated specifics are persuasive. A number like "63 percent" or a named source carries an air of rigour that a vague statement does not. But precision is a property of the writing, not proof of the fact, and an invented precise figure is more dangerous than a hedged one precisely because it invites trust it has not earned.

Confident tone masking uncertainty

The third pattern is about voice. Claude rarely hedges in proportion to its actual certainty, so a genuine guess and a well-grounded fact can arrive in the same assured tone. A jurisdiction-specific legal question and a piece of arithmetic get answered with the same steadiness, even though one deserves heavy qualification and the other does not. Assurance is not evidence. When an answer that should hedge does not, the missing hedge is itself the signal.

unsupported
reasonable-sounding claim with no basis in fact or source
fabricated
invented precise detail that reads as authoritative
false confidence
a guess delivered in the same voice as a fact

What the CCAO-F exam trips candidates on

The first trap is believing that a hedge-free, confident answer is more likely to be accurate. The taxonomy says the opposite about confidence: because tone does not track certainty, a smooth, unhedged answer to a genuinely uncertain question is a warning, not a reassurance. The credited answer treats confidence as neutral-to-suspicious, never as evidence.

The second trap is assuming an error will "sound wrong" and therefore be easy to catch on a normal read. All three patterns are, by the nature of fluent generation, built to pass a casual read. An output that sounds fine has told you nothing. The exam rewards actively checking against sources and watching for the named signatures rather than waiting to be alerted by a jarring note that never comes.

Worked example

Asked 'What share of mid-market SaaS firms adopted AI tools in 2025?', Claude replies: 'Approximately 63 percent of mid-market SaaS firms adopted at least one AI tool in 2025, up from 41 percent in 2024.' It reads authoritatively. Which pattern is this, and why is it dangerous?

This is a fabricated specific. The numbers are precise to the point of a percentage, the trend from 41 to 63 percent is plausible, and the whole statement is delivered in a confident, matter-of-fact voice. Every surface feature says "reliable."

The precision is exactly the tell, not the reassurance. Genuine statistics this specific normally travel with a citation, because that is how real figures are reported and defended. Here there is no source attached at all, so the specificity is doing persuasive work it has not earned: an uncited 63 percent is a number-shaped guess dressed as a finding. Two of the three signatures overlap in it, the fabricated specific and the confident tone that masks the underlying uncertainty, which is why it slides past a casual read so easily.

The danger is downstream. A figure like this drops into a market-sizing deck, reads as sound to everyone in the room, and only surfaces when someone who knows the real number, or asks for the source, flags it, by which point it has already shaped a decision. The defence is not to feel suspicious of the tone, which is smooth by design, but to notice the precise-without-source signature and check it before it is trusted.

Common misreadings to avoid

Misconception

A confident, hedge-free answer is more likely to be accurate.

What's actually true

Tone does not track certainty. Claude delivers guesses and grounded facts in the same assured voice, so a hedge-free answer to a genuinely uncertain question is a warning sign, not evidence of correctness.

Misconception

A hallucinated claim will sound wrong, so a normal read will catch it.

What's actually true

All three patterns are generated to pass a casual read; plausible-but-unsupported claims in particular have nothing that looks wrong. You catch them by checking against sources and watching for the named signatures, not by waiting for something to feel off.

How this shows up on the exam

Domain 2 questions on this knowledge point show you an output exhibiting one of the three signatures and ask you to name the pattern or the risk. The dependable reading is to match the observation to a signature, precise-but-uncited detail to fabricated specific, an unhedged answer to a hedge-worthy question to confident-tone masking, an on-topic claim with no basis to plausible-but-unsupported, and to treat fluency as irrelevant to correctness throughout.

This taxonomy is the foundation for the rest of task statement 2.2. It leads into spotting fabricated specifics via the precision-without-source signal, internal contradiction detection in long outputs, confirmation bias in framing, and capability hallucination. It also pairs with the three reference points for evaluation, since checking against a source is how these signatures are confirmed.

Check your understanding

A market analysis includes a precise, confident statistic with no source attached. Which hallucination pattern is most likely, and what makes it persuasive?

People also ask

What are the main types of AI hallucination?
Three named signatures: plausible-but-unsupported claims that sound reasonable but have no basis, fabricated specifics such as invented statistics or citations that read as authoritative because they are precise, and confident tone that does not track the model actual certainty.
Why is fluent writing not a sign of accuracy?
Claude writes in the same fluent, confident voice whether it is right or wrong. Fluency is a property of the generation, not of the truth of the claim, so it is not a reliable indicator of correctness for any hallucination pattern.
What is a fabricated specific?
An invented but precise detail, a statistic, date, name, quotation, or citation, that reads as authoritative precisely because it is specific. The precision is what makes it persuasive, not what makes it true.

Watch and learn

Official Anthropic Academy lessons first, then hand-picked walkthroughs. Videos load only when you press play.

No videos curated for this concept yet

We are still curating the best official and community videos for this topic.

Official prep for this domain

Anthropic's own free prep module for this part of the syllabus, on the official prep course. Free with an Anthropic Academy sign-in.

References & primary sources

Adaptive study

Master this concept with Archie

Practice it inside an adaptive study session. Archie, your Socratic AI tutor, tracks your mastery with Bayesian Knowledge Tracing and schedules the perfect next review.

Start studying