Sonith Manakkat

Claude AI, part 2 of 129 min read12 visuals

The basics to understand before you use Claude seriously

The prompt, system prompts, the context window, thinking, tools, agents and hallucination, each explained with a picture first and an expert layer second.

  • Claude only sees the page it is handed
  • A bigger context window is a bigger desk, not a better memory
  • Tools and agents multiply what Claude can do, and what you must review

Share on LinkedIn

Share
Reading level

Part 1 explained what Claude is. This part gives you the handful of ideas that make everything else easier. Once you understand them, advice about "how to prompt" stops feeling like magic and starts feeling like common sense. Each section has a plain picture first and an Expert view you can open for the precise mechanics.

1. The prompt is everything Claude sees

When you chat with Claude, your message is only part of what it reads. Each time it answers, it re-reads a whole "page" built from several pieces.

System promptstanding instructionsConversation so farevery earlier messageAttachmentsfiles, images, pasted textTool resultswhat tools returnedYour new messagethe question right now
The page Claude reads each time, from standing instructions to your newest message.
Expert viewWhat counts toward the limit

Anthropic's context window documentation says everything in a request counts: the system prompt, every message in the conversation (including tool results, images and documents), and your tool definitions. The reply Claude writes counts too, including any extended thinking.

Each API response reports what it used in a usage field. If you use prompt caching, the input count is split across input_tokens, cache_read_input_tokens and cache_creation_input_tokens, and all three count toward the window. To estimate a request before sending it, Anthropic provides a token counting endpoint. Chat apps such as claude.ai may also manage the window on a rolling first-in, first-out basis, according to a footnote in the same documentation.

  1. 1Must it change files or run commands on your computer?Yes Use an agent such as Claude Code, in a version-controlled folder, with approvals on.No keep going
  2. 2Will you reuse the same files or instructions across many chats?Yes Use a Project in the Claude app: its knowledge files and instructions apply to every chat in it.No keep going
  3. 3OtherwiseAn ordinary chat is enough for one question or one draft.

Takeaway. Start with the lightest option that does the job, and step up only when the job needs it.

Choosing how to use Claude. My own rule of thumb, using the features described in this series.

2. System prompts and roles

A system prompt sets the scene before the conversation starts, like briefing a new employee before the first customer arrives.

No role given

  • Answers in a general, middle-of-the-road style
  • Longer, with more caveats

A one-line role given

  • Focused on one job, such as "friendly maths tutor"
  • Tone and level match the audience
The same question, with and without a role.
Expert viewRoles in practice

Anthropic's prompting guidance says that setting a role in the system prompt focuses Claude's behaviour and tone, and that even a single sentence makes a difference. When you use a ready-made product, someone else wrote the system prompt. When you build a tool, or use a feature that lets you set standing instructions, you write it.

System prompts also count toward the context window and are re-sent every turn, which is exactly why repeated, stable text is a good candidate for prompt caching (part 5).

3. The context window: the desk

The context window is how much Claude can hold in view at one time, measured in tokens (small pieces of text, explained in part 5).

QuestionEarlier chatFilesAnswerOnly what fits on the desk can be usedToo much? Older papers fall off the edge, or get summarised.
Only what fits on the desk can be used. Everything in the conversation takes up space.
  • 1Mtokens in the window of all four current models
  • 555kwords, roughly, per 1M tokens
  • 128ktokens of output per request, at most
Facts from Anthropic's documentation.
Expert viewContext rot and curation

Anthropic's documentation describes the window as a kind of working memory, different from the huge body of text the model was trained on. It also warns that more context is not automatically better: as the number of tokens grows, accuracy and recall can degrade, an effect it calls context rot. That makes curating what is in context as important as how much space is available.

If input alone exceeds the window, the API returns an error. On newer models, if input plus the requested maximum output exceeds the window, the request is still accepted, and generation simply stops with a specific stop reason if it reaches the limit. For long-running work, Anthropic offers server-side compaction (beta) that summarises earlier turns, and context editing to clear old tool results. Part 6 goes deeper.

4. Models: pick the right size

Anthropic currently offers four models: Fable 5.1, Opus 5.5, Sonnet 5.5 and Haiku 5.5. In rough terms, Haiku is fastest, Sonnet balances speed and intelligence, Opus is for long-running coding and knowledge work, and Fable is for the hardest reasoning.

Myth

Always use the biggest model

Fact

A small task rarely needs it. Bigger models are slower and cost more per token (part 4). Use the smallest model that does the job well.

Expert viewCost-aware selection

Anthropic's own cost-optimisation advice is to use Haiku for simple tasks, Sonnet for most production workloads and Opus for the most complex reasoning. It also lists a "latency" comparison: Haiku fastest, Sonnet fast, Opus moderate, Fable slower. A practical pattern is to start with the smaller model and only move up when your own test cases show it falling short.

5. Thinking

Current Claude models can think before answering, which means working through reasoning steps first.

HardquestionReasoningstepsFinal answer
Thinking happens before the visible answer.
Expert viewAdaptive thinking and tokens

Anthropic's documentation says that with adaptive thinking the model decides how much thinking a task needs, so harder questions get more. Thinking tokens are part of the output limit, are billed as output tokens, and count toward rate limits and the context window. On some models earlier thinking blocks are kept in the conversation by default and count as input on later turns; on others they are stripped automatically. Check the per-model behaviour in the documentation if you build on it.

6. Tools

On its own, Claude only produces text. Tools let it do more.

ClaudeWeb searchRun codeRead filesOther apps
Claude at the centre, tools around it.
Expert viewHow a tool call works

Anthropic's documentation mentions web search and code execution as tools its models can use, among others. When Claude uses a tool, the tool's result is returned into the conversation and Claude carries on from there. Tool definitions and results both consume context, so a long tool list or a huge tool result has a cost. Claude Code defers loading full tool schemas for connected MCP servers until needed, which keeps idle tools cheap.

7. Agents

An agent is Claude in a loop with tools.

LookPlanActCheckrepeat
An agent repeats a small loop until the goal is reached or it needs your help.

The more steps an agent takes, the more important it is to review the work. Part 11 covers Claude Code and safe agent use.

8. Hallucination and honesty

Claude sometimes states false things with complete confidence.

Myth

If it sounds sure, it is right

Fact

Confidence of tone says nothing about accuracy. Ask for a quote or source, and check what matters.

  1. Ask for the exact quoteOr the source, when you need a fact.
  2. Ask it to say when unsureAnd to separate what it knows from guesses.
  3. Verify before you actEspecially for money, health and legal points.
Three habits that help.
Expert viewReducing hallucination in practice

Anthropic says its latest models are less prone to hallucination than earlier ones. Its prompting guidance for coding includes a sample instruction telling Claude to read the relevant files before answering questions about a codebase and never to make claims about code it has not opened. The general principle is to ground answers in material actually present in the context and to make "I do not know" an acceptable answer.

9. The same question can give different answers

Ask the same thing twice and you may get differently worded replies. That is normal. To get the same shape every time, say exactly what format you want and show an example.

You askClaude draftsYou checkGive feedbackGood enough12345
  1. You ask to Claude drafts You send a clear request with the page Claude needs.
  2. Claude drafts to You check Treat the first answer as a draft and look at it carefully.
  3. You check to Give feedback Something is off or missing, so you say exactly what.
  4. Give feedback to Claude drafts Claude revises with your feedback on the page.
  5. You check to Good enough It is right for the purpose, and you checked what matters.

Takeaway. Specific feedback and a real check beat a longer first prompt.

The ask, check, refine loop that most good results follow.

Putting it together

When a result disappoints, check the page Claude saw. Was the goal clear? Was the right information there? Was there too much unrelated material? Was the model suited to the task? Was a tool missing? Most problems are on that list.

Frequently asked questions

Does Claude learn from my chat?

Within a conversation it uses what is on the page. Whether your chats are used to improve models depends on your plan and settings, so read the privacy settings of the product you use.

Why does Claude seem to forget things from earlier in a long chat?

Long chats fill the context window, and quality can drop as it grows. Summarise and start a fresh chat for a new phase of work.

Do I need to know any maths?

No. Everything in this series is about writing, organising and checking.

Sources

Last checked: 2026-10-21. These are official pages. Check them for anything that may have changed since.

  1. Claude models overview
  2. Context windows, official documentation
  3. Prompting best practices, official documentation
  4. Claude API pricing and cost advice
  5. Claude Code overview

Back to all articles