Topic · Concept

Long context

Long context refers to a model's ability to take in very large inputs, now commonly a million tokens or more, in a single request. Bigger windows let a model read whole codebases or long documents at once, but a large window is not the same as reliable recall of everything in it.

11 stories · updated Oct 9

Key facts

Checked Oct 9