RS Glossary
Chunking
Chunking is the process of dividing a document, dataset, or stream into smaller units for storage, search, retrieval, or processing.
- Review state
- Reviewed in POC
- Freshness
- Current
- Version
- 3
- Chunking
- Chunk
Remember it this wayChunk where the meaning can travel together.
In plain language
Chunking divides a document, dataset, or stream into smaller units that a system can store, search, retrieve, or process. The boundaries may follow length, structure, meaning, time, or a combination of these.
Why it matters
Chunk boundaries determine what context stays together. Poor chunks can split evidence from its qualifier, create noisy retrieval, or exceed a model’s context limits.
Example
A policy manual is divided by section headings, with a small overlap between adjacent sections, before each chunk is embedded for retrieval.
Common misconception
Chunking is not simply cutting text into equal character counts. Fixed-size chunks are one method, and they may damage meaning when structure matters.
Related terms
Sources
- Patrick Lewis and colleagues, “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks”shows retrieval over indexed passages as external model context.
Learn more
- Compare [[retrieval-augmented-generation|Retrieval-Augmented Generation]], [[embedding|Embedding]], [[context-window|Context Window]], and [[search-retrieval|Search / Retrieval]] to place Chunking in the surrounding system.
- Follow the cited source material above for the method, standard, or research context behind this draft.
Public history
24 recorded events · 24 public summaries
A potential shared concept was discussed and selected for initial glossary drafting.
The captured candidate received a complete initial draft and entered section-level human review.
Radar reviewed the initial definition draft for human consideration.
Radar reviewed the initial plain-language-explanation draft for human consideration.
Radar reviewed the initial why-it-matters draft for human consideration.
Radar reviewed the initial example draft for human consideration.
Radar reviewed the initial common-misconception draft for human consideration.
Radar reviewed the initial remember-it-this-way draft for human consideration.
Radar reviewed the initial related-terms draft for human consideration.
Radar reviewed the initial sources draft for human consideration.
Radar reviewed the initial learn-more draft for human consideration.
Definition review recorded as replace.
Radar reviewed Mike's accepted definition replacement for this exact wording version.
Plain-Language Explanation review recorded as approve.
Why It Matters review recorded as approve.
Example review recorded as approve.
Common Misconception review recorded as approve.
Remember It This Way review recorded as approve.
Related Terms review recorded as approve.
Sources review recorded as approve.
Learn More review recorded as approve.
Sources review recorded as replace.
Radar verified the learner-facing sources after personal origin provenance was removed.
All nine current wording approvals were reconciled to Approved term status.
Source: vault/Glossary/terms/chunking/term.md · sha256:45b163067d6c76072e0db7fc04290c272c144631a302c1cf9c9fd7870322466d · Release: rs-glossary-glossary-team-poc-0.5.5-2026-09-02