AI DevelopmentDecision Matrix12 min readPublished September 1, 2026

The request succeeds. Nothing errors. That is the problem

Switch Off Claude Fable 5.1 Mid-Task and It Forgets Why

Claude Fable 5.1 writes reasoning that no cheaper Claude model can read. The moment a router, a retry or a safety fallback moves a running task onto Opus 5 or Sonnet 5, that reasoning is stripped and the cheaper model starts again from the transcript alone.

DA
Digital Applied Team
Senior strategists · Published Sep 1, 2026
PublishedSep 1, 2026
Read time12 min
SourcesAnthropic migration guide
Models that can read Fable 5.1 thinking
2
Fable 5.1 itself and Mythos 5.1. No Opus, no Sonnet, no Haiku
Direction that keeps reasoning
Up
Opus 5, Fable 5 and older blocks are readable by Fable 5.1
Error you get on the downgrade
None
blocks are dropped, the call succeeds, dropped tokens are unbilled
Beta header that makes it visible
1
thinking-binding-controls-2026-08-01 reports each dropped block

Claude Fable 5.1 shipped on September 1, 2026 with a rule that most release coverage reduced to a bullet point: its thinking blocks can be read by Fable 5.1 and Mythos 5.1, and by nothing else. Anthropic states it plainly in the migration guide. Fable 5.1 reads the reasoning of Opus 5, Fable 5, Mythos 5 and every earlier Claude model, so a conversation moving up onto 5.1 keeps its history. The condition is one-way. If a conversation that has been running on Fable 5.1 lands on any older model, the API removes the blocks that model cannot read before it sees them.

That sentence matters far more than it sounds, because production agent systems move conversations between models all the time and almost never on purpose. A cost router downgrades a routine step. A retry wrapper falls back after a timeout. A safety classifier declines a request and the fallback setting re-runs it on Opus 5. In every one of those cases the cheaper model receives the transcript, the tool calls and the tool results, and none of the reasoning that produced them. Anthropic’s own description of the consequence is that “the target model re-plans without that reasoning, which can raise cost and latency on the first turn after the switch.” This post is about what that means for a loop you already run, and the one routing rule that avoids it.

Key takeaways
  1. 01
    Reasoning travels up the model ladder, never down.Fable 5.1 reads thinking blocks from Opus 5, Fable 5 and earlier models. Only Fable 5.1 and Mythos 5.1 can read Fable 5.1’s. Every other Claude model has those blocks stripped before it sees the conversation.
  2. 02
    The downgrade is silent and it is not an error.The API drops the unreadable blocks, the request succeeds, and you are not billed for the dropped tokens. The cheaper model re-plans from the transcript alone. Nothing in the response says so unless you send a beta header.
  3. 03
    Four ordinary mechanisms trigger it.A cost router, a client-side retry onto a different model, a classifier refusal with fallbacks enabled, and a manual switch to save money. Anthropic names the first three in the migration guide. The fourth is the one teams do deliberately.
  4. 04
    Lower effort, not tier, when you need to spend less.Anthropic’s own guidance is that Fable 5.1 at medium effort roughly matches Fable 5 at lower cost. Effort can change mid-conversation without losing reasoning or cache. A model change cannot.

01The ruleEvery thinking block now records which model wrote it.

A thinking block is the reasoning a Claude model produces before it answers or calls a tool. In a multi-turn conversation you pass those blocks back with the history, and the model uses them to continue where it left off rather than re-deriving its plan. On Fable 5.1, each block carries a signature that identifies the model that produced it and the conversation it was produced in. The table below is the compatibility rule as Anthropic documents it, read from the point of view of a conversation that has already been running on Fable 5.1.

Which Claude models can read thinking blocks produced by Claude Fable 5.1, per Anthropic’s migration guide as of September 1, 2026. “Keeps reasoning” means the blocks are passed to the model intact; “loses reasoning” means the API removes them before the model sees the request.
Conversation moves from Fable 5.1 toResultWhy
Claude Fable 5.1 (same model)keeps reasoningSame model, same conversation. The only condition is that earlier turns are unchanged.
Claude Mythos 5.1keeps reasoningThe same model under different safeguards, and the one exception Anthropic names. Only Project Glasswing participants can call it.
Claude Opus 5loses reasoningAn older model. Anthropic states directly that “Claude Opus 5 can’t read Claude Fable 5.1’s blocks.” Opus 5 is also one of the two permitted refusal-fallback targets.
Claude Opus 4.8loses reasoningThe other permitted refusal-fallback target, and the model most existing fallback chains were written for.
Claude Sonnet 5, Haiku 4.5, Fable 5, Mythos 5loses reasoningAll older generations. The rule is “the model that produced them, or a newer one,” and as of September 1 nothing is newer than Fable 5.1.
The reverse: Opus 5 or Fable 5 up to Fable 5.1keeps reasoningFable 5.1 reads blocks from Opus 5, Fable 5, Mythos 5 and earlier models. Escalating a stuck task upward costs nothing in continuity.

Two details in that table decide the rest of the post. First, the two models Anthropic permits as automatic fallback targets for Fable 5.1, Opus 4.8 and Opus 5, are both on the losing side of the line. A refusal fallback is therefore a downgrade by construction. Second, the direction is asymmetric in a way that is genuinely useful: starting a task on a cheaper model and handing it up to Fable 5.1 when it gets hard preserves everything. The expensive mistake is the other order.

02MechanismsFour ordinary ways a running task ends up on a cheaper model.

Anthropic’s guide names three routes by which “a conversation that ran on Claude Fable 5.1 can land on an older model”: a router switch, a client-side retry, and a classifier refusal fallback, including the server-side fallback Anthropic itself offers. There is a fourth that the guide does not need to name because it is deliberate: the cost-saving handoff, where a team runs the hard planning turn on Fable 5.1 and the routine execution turns on something cheaper. All four produce the same result. They differ in how often they fire and how easy they are to notice.

Route one
The cost router
Per-turn model selection

A router that scores each turn and sends easy ones to Opus 5 or Sonnet 5 will move a Fable 5.1 conversation down many times per session. Every downward hop strips the reasoning accumulated on 5.1; every upward hop keeps it. A router tuned before September 1 has no idea the two directions are no longer symmetric.

Fires constantly, invisible
Route two
The retry wrapper
Timeout or 5xx, then a different model

A resilience layer that retries a failed call on a fallback model is doing the right thing for availability and the wrong thing for continuity. The retried turn arrives at Opus 5 without the plan that the previous nine turns built. It will usually still succeed, which is why nobody notices.

Fires rarely, hurts most
Route three
The refusal fallback
stop_reason refusal, fallbacks enabled

Fable 5.1 runs safety classifiers for cyber, biology and reasoning-extraction categories. When one declines a request and fallbacks are set to default, Anthropic re-runs it on the model it recommends, which for Fable 5.1 is Opus 4.8 or Opus 5. The guide states the fallback model does not receive Fable 5.1’s thinking blocks.

Sanctioned, still a downgrade
Route four
The deliberate handoff
Plan on Fable, execute on Sonnet

The pattern many teams adopted to make Fable affordable: one expensive planning turn, then cheap execution turns in the same conversation. On Fable 5.1 the executor never sees the plan’s reasoning, only its text. Whether that matters depends on how much of the plan was in the words and how much was in the thinking.

Deliberate, now needs re-testing

The refusal route deserves one more sentence because it is the only one Anthropic actively encourages. The fine print of the launch, which we covered in what Claude Fable 5.1 costs and what it breaks, is that Fable 5.1 still redirects penetration testing, exploit generation, binary vulnerability scanning and life-sciences research to the Opus models. A fallback path is therefore still required for any agent that might wander into those areas. It is just that the fallback now arrives with amnesia, and a security agent that has spent twenty turns building context on a codebase is exactly the kind of task where that hurts.

03The billYou are not charged for the dropped tokens. You are charged for the re-plan.

It is worth being exact about what is and is not billed, because the shape of the cost is unusual. Anthropic states that when blocks are removed for a model that cannot read them, “the request succeeds, and you aren’t billed for the dropped input tokens.” So the direct cost of the switch is zero, and on a per-request dashboard the downgraded turn can look cheaper than the turns around it. The cost lands one step later. The cheaper model has to reconstruct, from transcript alone, a plan that the expensive model already held in its reasoning, and Anthropic’s stated consequence is higher cost and latency “on the first turn after the switch.”

Three things follow for anyone measuring this. The first is that the cost is paid in the cheaper model’s output tokens and thinking, which is why it does not show up as a spike on the Fable line of the bill. The second is that on a long task the first turn after the switch is not the only one affected: a re-planned task can take a different route to the same goal, calling tools the original plan had ruled out. We have no measurement of how large that effect is on real workloads, Anthropic does not publish one, and the honest statement is that it depends on how much of the plan lived in the reasoning rather than the text. The third is that a conversation which is bounced down and then back up pays twice: once for the re-plan on the cheap model, and once more when Fable 5.1 resumes with a history that now contains the cheap model’s reasoning in place of its own. That upward hop keeps the Opus blocks, which is better than nothing, but they are Opus blocks.

Where the price sheet pushes you

The economics of Fable 5.1 already reward staying put. Its cache read is $0.25 per million tokens, half of Opus 5’s $0.50, so on a long session the flagship’s per-turn cost falls below the mid-tier’s once cached context grows large, an arithmetic we worked through in the launch cost analysis. A downgrade mid-session gives up that cache advantage and the reasoning at the same moment. The cheapest long agentic session on Claude is now, more often than before, the one that never changes model.

04ObservabilityOne beta header turns a silent drop into a logged one.

By default nothing in the response tells you that reasoning was removed. Anthropic provides a way to change that. Send the beta header thinking-binding-controls-2026-08-01 and responses carry an input_transformations array that names each dropped block with a reason. Two reasons exist and they mean different things:

  • model_binding_mismatch: a block was produced by a model the current one cannot read. This is the downgrade described in this post. After a model switch it is expected; anywhere else it means a switch happened that you did not intend.
  • prefix_binding_mismatch: a block was produced against a system prompt, tool list or history that has since changed. This is the other Fable 5.1 rule, the one that makes conversation history append-only, and it is a bug in your harness rather than a routing decision.

The practical use is a two-line audit. Run a representative session with the header set, log the array on every response, and count the model_binding_mismatch entries. Each one is a turn where a cheaper model re-planned from scratch. If the count is non-zero and you did not design a downgrade into the loop, one of the four routes above is firing without your knowledge, and the retry wrapper is the usual culprit. Anthropic adds a note for anyone who ships a tool that other people run with their own API keys: the history check is enforced by default only for accounts created on or after August 31, 2026, so your key may be older than your users’ and you should test with the controls set rather than waiting to hit the error yourself.

05The decisionEscalate models. Lower effort. Never downgrade mid-task.

The asymmetry in the compatibility table gives you a routing rule that is simple to state and, conveniently, matches Anthropic’s own advice to start most workloads on Opus 5. Begin a task on the cheapest model that might finish it. If it stalls, hand the same conversation up to Fable 5.1, which reads everything the cheaper model thought. Once a conversation is on Fable 5.1, keep it there until the task boundary. When the bill needs to come down, change the effort level, not the model. Anthropic’s launch guidance is that Fable 5.1 at medium effort “roughly matches Claude Fable 5 at lower cost,” and on Fable 5.1 effort can be changed part-way through a conversation with a system message that carries only an output configuration, without invalidating the prompt cache or any thinking block. A model change can do neither. Our effort ladder reference lists what each level maps to across vendors.

A task on Opus 5 or Sonnet 5 stalls
Hand the same conversation up to Fable 5.1. It reads the cheaper model’s thinking blocks, so nothing is lost and the cache prefix survives. This is the direction the rule was designed for.
Move up, keep the conversation
A Fable 5.1 session is costing too much
Lower effort with a mid-conversation output configuration rather than switching model. Medium is Anthropic’s stated cost control; the change keeps every thinking block and every cached prefix.
Lower effort, same model
A Fable 5.1 call times out or errors
Retry on Fable 5.1 first. Fall back to Opus 5 only at a turn boundary you can afford to re-plan, and log the model_binding_mismatch entries so the cost is visible rather than assumed.
Same-model retry first
A classifier declines a request
Keep fallbacks enabled; the categories Fable 5.1 still redirects need it. But treat the fallback turn as a fresh start on Opus, and consider running the whole task on Opus 5 if refusals are likely from the outset.
Fallback, but expect a re-plan

The one pattern this rule changes most is the deliberate handoff, plan on Fable and execute on something cheaper in the same conversation. It is not forbidden and it may still be the right trade. It now needs the plan to be fully expressed in the text the planner returns, because the executor will see only that text. Teams that already write plans as explicit, self-contained artifacts will notice nothing. Teams that relied on the model carrying its intent forward in thinking will find the executor improvising. The general routing question, which model earns which turn, is covered in our model routing guide; what changed on September 1 is that on Claude the answer must now be decided per task, not per turn.

06Same trapCompacting on the client loses reasoning the same way.

The model-binding rule has a sibling, and any team that fixes one should fix both in the same pass. A Fable 5.1 thinking block is also bound to the conversation that produced it, meaning the system prompt, the tool list and every earlier turn. Change any of those and the blocks after the change are invalid. Where the check is enforced, the API rejects the request with a 400 stating that “the block is bound to a different conversation.” The patterns that trip it are the everyday ones: summarising old turns in place on the client, deleting old tool results, injecting a per-turn reminder and removing it next time, rebuilding the system prompt to update the date.

Anthropic’s recommended shapes are worth quoting because they are more permissive than the rule sounds. Simple compaction, where you replace the whole history with one summary message and replay nothing else, is fine because no thinking blocks are carried over at all, and Anthropic says its models perform comparably under that scheme to more elaborate ones. Keep-tail compaction, where recent turns stay verbatim behind a summary, works if you strip the thinking blocks from those turns or set the prefix-mismatch behaviour to drop them. Server-side compaction and context editing do not count as edits at all. The one thing no client-side shape survives is snipping individual turns out of the middle. The through-line with the routing rule is the same: on Fable 5.1, reasoning is attached to a specific model in a specific conversation, and anything that changes either of those throws it away. The cache economics that make keeping context cheap were covered in our cache-first agent design piece; this rule is the reason to act on them.

07ConclusionThe model is now part of the state.

Claude Fable 5.1 routing

Treat the model as part of a task’s state: escalate freely, lower effort to save money, and change model only at a boundary you can afford to re-plan.

Before September 1, a Claude conversation was portable. Any model could pick it up, and routers and retry wrappers were written on that assumption. Fable 5.1 breaks the assumption in one direction only, and does so without an error, which is the worst combination for a production system: the failure is real, quiet and easy to attribute to the cheaper model being worse rather than to the cheaper model being blind.

The fix is mostly a policy, not a rewrite. Start cheap and escalate. Once on Fable 5.1, stay there and use effort as the cost lever. Retry on the same model before falling back. Keep the refusal fallback, because you still need it, but stop expecting it to continue the task. And send the binding-controls header in at least one environment so that every downgrade is a line in a log rather than a mystery in a quality review.

If you run a hand-built agent loop, the same audit covers both rules. Log the transformations array for a day. Every model-binding entry is a routing decision to revisit; every prefix-binding entry is a place your harness edits history. Both lists are usually short, and both are worth clearing before the next model release makes the check apply to every account.

Route per task, not per turn

The downgrade is silent. The re-plan is not free.

We audit agent loops for the two Fable 5.1 binding rules, find where routers and retry wrappers are quietly downgrading tasks, and set effort and fallback policies that keep reasoning intact without paying flagship rates for routine turns.

Free consultationExpert guidanceTailored solutions
What we work on

Agent routing and migration engagements

  • Binding-controls audits on live agent traffic
  • Escalation-only routing policies for Claude
  • Effort sweeps measured on your own evals
  • Retry and refusal fallbacks that log every re-plan
  • Compaction shapes that keep the cache and the reasoning
FAQ · Claude Fable 5.1 routing

The questions we get about Claude Fable 5.1 routing.

No. Anthropic states the API removes the thinking blocks Opus 5 cannot read, the request succeeds, and you are not billed for the dropped tokens. Opus 5 then re-plans from the transcript, which Anthropic says can raise cost and latency on the first turn after the switch. The only way to see the drop is the thinking-binding-controls-2026-08-01 beta header.
Related dispatches

Continue exploring agent routing.