My grandmother has trouble remembering what she ate for breakfast. But she remembers my birthday. She remembers every grandchild's name. She remembers stories from forty years ago like they happened yesterday.
Her brain figured out what matters.
I used to think AI memory should be a perfect recording. Every conversation saved. Every detail searchable. Total recall.
I was building it wrong.
I've been working on Lorekeeper — an open-source memory system for AI agents. It started as a storage problem. How do I keep everything?
But storage isn't the hard part. The hard part is knowing what to keep.
Think about your own brain. You don't remember everything. You remember the important stuff. The conversations that mattered. The mistakes you learned from. The names of people you care about.
Everything else fades. That's not a flaw. That's the design.
I built a feedback loop into Lorekeeper. Every time an agent uses a memory, it can say "this was useful." The stuff that gets used stays. The stuff that doesn't fades.
I set it up, walked away, and forgot about it.
Two weeks later I asked my agent about a debugging session we'd had. A random import issue from weeks ago. I had completely forgotten about it.
My agent remembered. Not because I had saved it perfectly. Because over two weeks, across multiple sessions, that specific memory kept being useful. The system promoted it naturally.
It felt like running into an old friend who remembers something about you that you'd forgotten. That surprise of being known.
That's the thing nobody tells you about building AI tools.
The goal isn't perfect memory. The goal is to know what matters.
A system that remembers everything is like a closet so full you can't find anything. A system that forgets the right things is like a well-worn bookshelf — the books you actually reach for are right at eye level.
I spent months optimizing how much my agents could store. The real breakthrough was teaching them what to let go.
Lorekeeper is open source (Apache 2.0). pip install lorekeeper-mcp if you want to try it.
Star the repo if this resonates. Helps me know I'm not the only one thinking about this. It means a lot to me, thank you!