Tagged “core”
-
Context Window
The maximum amount of text, measured in tokens, that a language model can process in a single request — input and output together.
-
Chunk
A unit of text stored and retrieved as a single item in a retrieval system — the smallest thing a search can return. No standard size exists.
-
Embedding
A fixed-length list of numbers representing a piece of text, produced so that texts with similar meanings land near one another in the space.