Chunking
Paste text, change size and overlap, and see where the boundaries land.
2 chunks · ~60 tokens (characters ÷ 4) · step 140 chars
- Chunk 1180 chars
Retrieval augmented generation grounds an answer in documents. The index stores chunks, not whole files. Chunk size trades context against precision. Overlap keeps a sentence from
- Chunk 2100 chars
recision. Overlap keeps a sentence from being cut in half. Measure recall before changing the model.
Related: Chunking