What Is an AI Context Window and Why Models Seem to Forget
A short video from the Prompt Pad series explains why AI chatbots sometimes appear to forget earlier parts of a conversation. A context window is the maximum amount of text a model can read, process, and hold in memory at one time, and it is measured in tokens, which are fragments of words. Models with larger windows can handle more material at once, with a 128k-token window able to take in an entire book. When a conversation exceeds the limit, the oldest details are pushed out of the window and no longer available to the model. The video encourages viewers to check the context window size of the models they use most.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in