Tagged “core”
-
Document
In retrieval, a document is whatever unit the system treats as one retrievable item — which may be a file, a section, or a single chunk.
-
Document Loader
The component that reads a source file or system and returns its text plus metadata, before any chunking or embedding happens.
-
Faithfulness
The property of a generated answer whose every claim is supported by the retrieved context — regardless of whether those claims are true of the world.
-
Context Window
The maximum amount of text, measured in tokens, that a language model can process in a single request — input and output together.
-
Chunk
A unit of text stored and retrieved as a single item in a retrieval system — the smallest thing a search can return. No standard size exists.
-
Embedding
A fixed-length list of numbers representing a piece of text, produced so that texts with similar meanings land near one another in the space.
-
Hallucination
Model output that is presented as fact but is not supported by the supplied sources or by anything else — fluent, confident, and unfounded.
-
Grounding
Tying a model's output to specific supplied source material, so each claim in the answer traces back to text the system provided rather than to training.
-
Upsert
A write that inserts a record if its identifier is new and replaces the existing record if it is not — the usual way vectors enter an index.
-
Retriever
The component that takes a query and returns the passages a system should read — an interface, not a single algorithm or data structure.
-
Top-k
The setting that fixes how many results a retrieval step returns: the k highest-scoring items, and nothing about whether any of them are good.
-
Semantic Search
Search that matches on meaning rather than on shared words, so a query can retrieve a relevant passage with which it has no vocabulary in common.
-
Token
The unit of text a language model actually processes — a word, word-fragment, or character sequence produced by that model's tokeniser.
-
Corpus
The complete body of text a retrieval system searches over, treated as one bounded collection regardless of how many files or sources it came from.