Claude Models, Prompting & Context Engineering·Task 2.4·Bloom: remember·Difficulty 1/5·6 min read·Updated 2026-07-14

The Context Window as Bounded Working Memory for the CCAR-P Exam

Optimize context windows and manage token usage

SUBy Solomon UdohReviewed by Solomon UdohAI-assisted · human-reviewed
In short
The context window is the model's active attention space: everything inside it is available for reasoning, and everything outside it does not exist to the model for that call. It resets between calls unless the application explicitly manages continuity by re-sending history. Context is measured and billed in tokens, and actual token counts are reported in every API response's usage field rather than reliably estimated from a fixed characters-per-token ratio.

The model's working memory has a hard edge

Everything the model can reason about on a given call lives in one place: the context window. The Claude Certified Architect - Professional (CCAR-P) exam establishes this at the remember level because so many later decisions depend on it. The context window is the model's active attention space. Everything inside it is available for reasoning; everything outside it simply does not exist to the model for that call. There is no partial awareness of content that fell outside the window, and no gradual fade. The boundary is hard: in or out.

That hard edge is what makes context management a real engineering concern rather than a background detail. If something the model needs is outside the window, the model cannot use it, no matter how important it is.

Context window as bounded working memory
The model's active attention space for a single call, measured in tokens. Everything inside the window is available for reasoning; everything outside it does not exist to the model for that call. The window resets between calls unless the application re-sends history, and its token counts are reported in each API response's usage field rather than reliably estimated from a characters-per-token ratio.

It resets between calls

The second essential fact is that the context window resets between calls. The model has no native memory that carries from one API request to the next. If a second call needs to know what happened in the first, the application must explicitly re-send that history as part of the second request. Continuity across calls is something the application manufactures by re-injecting content, not something the model provides on its own.

This is easy to forget because a chat interface feels continuous. But that continuity is an application behaviour: the app is re-sending the accumulated conversation on each turn. Take that re-sending away and each call is a blank slate. Understanding this is the foundation for distinguishing context-related terms, where memory and summaries turn out to be application-managed rather than model-native.

Measured in tokens, not estimated

Context is measured and billed in tokens. Everything that enters the window, the system prompt, the conversation history, retrieved documents, tool outputs, and the model's own responses, counts against the token total, and you are billed per token. Two consequences follow: the window has a fixed token limit, and cost scales with tokens on every call.

Critically, token counts should be measured, not estimated. How much text one token covers varies by model, tokenizer, and language, so a fixed characters-per-token ratio is a rough illustration at best. Every API response reports the actual token counts in its usage field, and those measured counts are what the limit and the bill apply to. Relying on a fixed ratio instead of the usage field is a common and avoidable mistake. To stay ahead of the limit rather than react to it, you can also check the usage field on prior responses and use the token-counting API to size a request before you send it.

Two distinct ways to hit the edge

The hard boundary produces two different errors that are easy to conflate. The first is an oversized request: a prompt or conversation that is already too large before generation even starts. An oversized request is rejected up front, not truncated. If it exceeds the model's token limit, the API returns a 400 invalid_request_error saying the prompt is too long; if the raw request body exceeds the API's byte limit, it returns a 413 request_too_large error. The second error is different in kind: the request fits and generation begins, but the response runs into the window ceiling and stops early. On current models this comes back with a model_context_window_exceeded stop reason and truncated output rather than a rejection. The distinction matters for diagnosis: a rejected call needs a smaller input before you send it, while an early stop means the input fit but left too little room for the response you asked for.

inside
available for reasoning
outside
does not exist to the model for that call
usage field
the measured token counts that actually apply

What the exam trips candidates on

The two traps are the two ways people misunderstand the mechanism. The first is assuming the model retains memory of a previous, separate API call without the application re-sending that history. A scenario will expect the model to "remember" something from an earlier call; the credited reading notes the window reset and that continuity requires re-sending. The second is estimating tokens with a fixed characters-per-token ratio instead of using the measured usage field. A scenario will budget context from a rule-of-thumb ratio; the credited reading uses the reported usage counts, which vary by model and tokenizer.

Worked example

A developer builds a two-step flow: call one asks the model to analyse a document, call two asks 'now summarise your earlier analysis.' The second call returns something generic and wrong. They also sized their context budget assuming four characters per token. Diagnose both issues.

Both problems trace directly to how the context window works.

The second call fails because the context window reset between calls. Call two is a separate request, and unless the application re-sent call one's analysis as part of call two, the model has no access to it; that content is outside the window and does not exist to the model for this call. "Now summarise your earlier analysis" asks the model to recall something it cannot see. The developer assumed model-native memory across calls, which does not exist. The fix is to carry the analysis forward explicitly, by including call one's output in call two's request, so the needed content is inside the window.

The token budgeting is the second trap. A fixed four-characters-per-token assumption is only a rough illustration; the real ratio varies by model, tokenizer, and language, so a budget built on it can be materially off, risking an unexpected brush with the context limit or a mis-estimated bill. The correct approach reads the actual token counts from each response's usage field and budgets against those measured numbers.

Together the two fixes reflect the same underlying model: the window is bounded, resets between calls, and is measured in tokens you should read rather than guess.

Common misreadings to avoid

Misconception

The model remembers earlier API calls, so you can refer back to them without re-sending.

What's actually true

The context window resets between calls and the model has no native cross-call memory. Continuity exists only if the application re-sends the relevant history in the next request.

Misconception

You can budget context reliably using a fixed characters-per-token ratio.

What's actually true

Tokens per character vary by model, tokenizer, and language. Use the measured token counts in each response's usage field, which are what the context limit and billing actually apply to.

How this shows up on the exam

Remember-level questions ask what the context window is, whether the model remembers across calls, or how tokens should be measured. The reliable answer treats the window as bounded working memory that resets between calls, requires the application to re-send history for continuity, and is measured in tokens read from the usage field rather than estimated.

This knowledge point underpins distinguishing context-related terms, the context strategy spectrum, and the diagnosis of silent context growth, all of which build on the bounded, token-measured nature of the window.

Check your understanding

A developer makes one API call to analyse a document, then a separate call asking the model to 'summarise your earlier analysis,' but the app does not re-send the first call's output. Why does the second call fail?

People also ask

What is a context window?
The model’s active attention space for a single call, measured in tokens. What is inside is available for reasoning; what is outside does not exist to the model for that call.
Does the model remember previous API calls?
No. The window resets between calls. The model only retains an earlier exchange if the application re-sends that history in the next request.
How are tokens measured?
Every API response reports actual token counts in its usage field, and those measured counts, not a fixed characters-per-token estimate, are what the limit and billing apply to.

Watch and learn

Official Anthropic Academy lessons first, then hand-picked walkthroughs. Videos load only when you press play.

No videos curated for this concept yet

We are still curating the best official and community videos for this topic.

Official prep for this domain

Anthropic's own free prep module for this part of the syllabus, on the official prep course. Free with an Anthropic Academy sign-in.

References & primary sources

Adaptive study

Master this concept with Archie

Practice it inside an adaptive study session. Archie, your Socratic AI tutor, tracks your mastery with Bayesian Knowledge Tracing and schedules the perfect next review.

Start studying