LLM Context Rot

LLMs are context-driven services. You feed them some context and they generate a response. The context represents the entire chat conversation (or as much of it as fits within the context window The maximum number of tokens it can process at once ), and any additional files attached to that conversation.