mirror of
https://github.com/kamranahmedse/developer-roadmap.git
synced 2026-10-29 17:44:52 +08:00
github-actions[bot]andnilbuild
3b9fbc6b31
Co-authored-by: nilbuild <4921183+nilbuild@users.noreply.github.com>
410 B
410 B
Chunking
Chunking is the process of splitting a long document into smaller pieces before it gets indexed for retrieval. Systems typically search and retrieve at the chunk level rather than the whole-document level, since a smaller, focused piece of text is easier to match accurately to a specific question. How a document gets chunked can affect whether the right piece of information gets found and cited.