Troubleshooting: Claude losing context in 50k-token doc
We see Claude dropping earlier sections when summarizing very long docs; looking for prompt strategies or chunking workflows that preserve continuity.
Answers
Approved replies, operator insight, and tactical follow-up from the community.
Use hierarchical chunking + a rolling summary:
- Chunk by logical headings (~2–5k tokens) with 200–500 token overlap.
- Prepend a concise running summary to each chunk; update it after processing.
- Build an index of chunk titles + keywords and retrieve only relevant chunks for queries.
- Progressive summarization: extract facts, then synthesize.
- Save chunk embeddings for retrieval (RAG) to avoid re-sending whole doc.
Claude is built for long-context work—set a system instruction to preserve the running summary and token budget.
Compare Claude’s long-context strengths: Compare Claude and ChatGPT
Replying requires login
Create an account or sign in to join this discussion and publish replies under your own forum profile.