“LLMs Do Not Remember Anything”: They only process the context we give them.

The hidden engineering problem of context accumulation and context window overflow - and why bigger models alone won’t solve it. Most people interact with AI systems like ChatGPT the same way they’d chat with a colleague - assuming there’s some form of ongoing awareness happening behind the screen. You mention your name early in the conversation, come back to it ten messages later, and the model responds as if it remembered all along. That assumption is architecturally wrong.