Context Window
The maximum amount of text (measured in tokens) an AI model can consider at once. Larger context windows allow the model to reference more information in a single conversation.
Why it matters
The context window is the AI's short-term memory for a conversation or document. It matters because everything you want the model to consider, your question, past messages, and any pasted text, has to fit inside it. When a long chat starts losing track of earlier details, or a giant file won't process, the context window is usually the reason. Bigger windows let you work with more at once.
A concrete example
Imagine explaining a project to someone who can only hold about 20 pages in mind at a time. Feed them page 100 and they may forget page 1. Modern models have much larger windows, some fit whole books, but the limit still exists. If an AI ignores an instruction you gave far earlier in a very long chat, restating it usually brings it back into view.
How to use it
When a long conversation starts losing the thread, restate the important constraints rather than assuming they are still in view. For long documents, either use a model with a large window or retrieve only the relevant sections instead of pasting everything. Putting the most important instructions near the end of a long prompt often helps, since material in the middle of a very long context gets less reliable attention than material at either end.
The common mistake
Treating a large context window as a substitute for retrieval. Filling a million-token window with everything you own is slow, expensive, and often less accurate than retrieving the ten relevant paragraphs — more context is not automatically better context.
Related terms
Long Context
The ability of an AI model to process very large inputs — 100K to 1M+ tokens — in a single request. Enables analyzing entire codebases, books, or document sets at once without chunking or summarization.
Token
The basic unit of text that AI models process — roughly 3/4 of a word in English. 'Unbelievable' is 3 tokens. Token limits determine how much text a model can process at once.
RAG (Retrieval-Augmented Generation)
A technique where the AI retrieves relevant information from a knowledge base before generating a response, reducing hallucinations and grounding outputs in real data.
Artificial Intelligence (AI)
The simulation of human intelligence by computer systems, including learning, reasoning, and self-correction. Modern AI is primarily powered by machine learning and neural networks.
Large Language Model (LLM)
An AI model trained on vast amounts of text data that can generate, summarize, translate, and analyze human language. Examples include the GPT, Claude, Gemini and Llama families.
Natural Language Processing (NLP)
The branch of AI focused on enabling computers to understand, interpret, and generate human language. Powers chatbots, translation, sentiment analysis, and text summarization.