Skip to content
AI Engineer Guide.

Chunking

Paste text, change size and overlap, and see where the boundaries land.

2 chunks · ~60 tokens (characters ÷ 4) · step 140 chars

  1. Chunk 1180 chars

    Retrieval augmented generation grounds an answer in documents. The index stores chunks, not whole files. Chunk size trades context against precision. Overlap keeps a sentence from

  2. Chunk 2100 chars

    recision. Overlap keeps a sentence from being cut in half. Measure recall before changing the model.

Related: Chunking