Why does AI forget what I just told it?

Start here

It's short-term memory, and it's small.

An AI has two very different kinds of memory. There's everything it learned during training — broad general knowledge, like the years of experience a tradesperson walks onto a job with. And there's its short-term memory for the conversation you're having right this minute: what you've typed, what it's replied, and anything you pasted in. The context window is that second kind — the short-term memory — and it has a fixed size.

Picture a whiteboard. Everything the AI needs to answer you has to fit on the whiteboard at the same time: your question, the chat so far, the document you dropped in. If it's on the board, the AI can use it. If the board filled up and something got wiped to make room, that something is simply gone as far as this conversation goes. It isn't tucked in a drawer the AI can reopen — it's erased.

That's the entire idea. A whiteboard that only holds so much, and a conversation that keeps writing on it.

The cause

Why it "suddenly" forgets.

Every time you send a message, the AI re-reads the whole conversation from the top to write its next reply. It doesn't truly remember the chat — it re-reads it, start to finish, every single turn. The longer the conversation gets, the more it has to cram onto that whiteboard each time. Eventually the board fills up.

When it's full, the oldest material gets wiped to make room for what's new. Usually that's a detail you mentioned way back at the start — the budget, the customer's name, the one rule that mattered most. From the AI's point of view, you never said it, because it's no longer on the board. That isn't the AI ignoring you. It genuinely can't see it anymore.

The tells

How to know it's a context problem.

These three symptoms almost always mean you've filled the window — not that the AI got dumber:

• It forgets an instruction you gave earlier. You said "keep your answers short" twenty messages ago, and now they're long again. That instruction aged off the board.
• It contradicts itself in a long chat. It can't stay consistent with something it can no longer see.
• It seems to ignore most of a long document you pasted. The document was bigger than the board, so it's working from a slice of it, not the whole thing.

Once you recognize the pattern, the fix is usually obvious — and none of it takes a technical background.

What to do

Four habits that fix most of it.

• Repeat the important stuff right before you need it. Don't assume the deadline or budget from earlier is still on the board. Restate the one or two facts that decide the answer, right before you ask for it.
• Paste the slice, not the whole binder. The two paragraphs that matter beat the thirty-page manual. Smaller and on-target wins over bigger and complete — almost every time.
• Keep one chat per job. Don't run your taxes, a marketing email, and a customer reply in the same thread. Each one piles clutter onto the others' whiteboard.
• Ask for a summary before you switch gears. "Summarize what we've decided so far" gives you a tight recap you can carry into a fresh chat — the good stuff, none of the clutter.

The reset

When in doubt, start a new chat.

The single most reliable fix when an AI gets stuck, repetitive, or forgetful is the simplest one: open a brand-new conversation and paste back in only what matters. You're wiping the whiteboard clean and writing just the essentials on it. Nine times out of ten, the "broken" AI was only a crowded board.

A good rule of thumb: if you've moved on to a genuinely different task, start fresh. If you're three messages deep in repeating yourself, start fresh. It costs you nothing, and it's faster than wrestling a cluttered chat back into shape.

"Most of the time, the AI didn't get dumber. The whiteboard just got full. Wipe it, write back only what matters, and it 'remembers' again."

The real fix

When the workarounds aren't enough.

The habits above cover everyday use. But if you find yourself feeding the AI the same big pile of information over and over — your pricing, your policies, your past jobs — retyping or re-pasting it every time gets old fast, and it never all fits on the board anyway. That's the point where you stop fighting the whiteboard and set up a system that hands the AI only the relevant page for each question, automatically. (The technical name is retrieval, or RAG — but you don't need to know that to benefit from it.)

This is also why some AI setups feel like they genuinely "know your business" and others don't. It usually isn't a smarter model. It's a system built around the context window instead of against it — so the right information lands on the board at the right moment, without you babysitting it.

The full playbook

Where to take this next.

Related reading on the site

If this landed, the next pieces.