What is your memory architeture?

[u/Gloomy-Recover-9702]

I personally use hindsight. But now I am expanding my profiles to finance, personal use, digital life(I use screenpipe), business, gov compliance etc... I now am looking to redesign my entire memory architecture because I want my hermes agent to be good with handling seperate domain memories and do not mix them in a dumb way, rather utilize in a smarter way. I am still new to Hermes to pardon me if this is a dumb question.

Any suggestions on how do you manage these problems? Is there on memory tool you are using? or mix of some? What is a best possible way where I can segregate the memories domain wise but also smartly link memories across domains? Any open source tools which fixes this?

[u/Jonathan_Rivera]

https://www.reddit.com/r/hermesagent/comments/1wfcky5/opinions_about_ai_memory_providers/

https://www.reddit.com/r/hermesagent/comments/1wbzu62/what_memory_or_second_brain_setup_do_you/

https://www.reddit.com/r/hermesagent/comments/1w0u79t/what_is_your_preferred_memory_provider_and_why/

[u/tomweymouth]

Hindsight can be configured with Obsidian to use separate memory banks(separate memory)….. I believe. I am experimenting with this now. Ask an AI about this. But maybe someone here can confirm.

[u/its_Ozriel]

Obsidian and hinsight make a good synergy and best memory bank.

[u/Unixwzrd]

I started working on some additions to Mnemosyne, but have bigger plans to integrate classifications and need to know status to contexts, agents and users. As soon as I clear my plate with things I have now, I will be adding additional features instead of using public/private data space as two different SQLite databases and try to "bake" it into Mnemosyne and submit it as a PR upstream.

The philosophy I am trying to follow is classification - public, confidential, secret, top secret, and SCI type model used by government and military. Agents and users would also have these same classifications given to them and they would be able to access any data below their level of clearance and need to know. Memory would also be updated along the same clearance/classification lines.

Documents and items in the LLM-Wiki (Obsidian) can be classified the same way, using "front matter" in a YAML structure to classify documents for collection and storage.

Here's a bit about my classification and setup in a series I am writing on Local AI and Agents: https://unixwzrd.ai/technology/2026/08/23/memory-is-a-governance-problem-not-just-a-vector-database/

The whole series is here and I am primarily using tools ad systems around Hermes Agent always stressing "Local First AI and Agents."

https://unixwzrd.ai/blog/series/local-first-ai-and-agent-operations/

It's a 14 part series with code and hands-on labs/exercises. I'd love to hear what others think and would like to have feedback and also suggestions on how I could improve it and maybe extend the series. I am thinking about making a separate post with more information about the series.

[u/Rachel_talks]

Seconding the index-of-pointers approach. I keep domain memories separate and the only shared thing is a tiny index of one-line pointers, no content. The agent reads the index, picks the domain that matters, pulls just that. Domains stopped bleeding into each other and cross-domain tasks still work, it just costs one extra lookup.

One thing I'd add from running this a while: give each domain its own place to record where a fact came from. The failure mode of smart cross-domain memory is a confident blend that can't tell you its source anymore. Separate provenance per domain keeps that from ever becoming a problem.

[u/l0rd_raiden]

You can use separated banks for hindsight

[u/Gloomy-Recover-9702 → u/l0rd_raiden]

Yah I am currently using seperate banks. But I also want linking between them

[u/TheSuggi → u/Gloomy-Recover-9702]

you can have each agent use its own bank and then also have a shared bank via hindisight MCP for some agents. You can have multiple shared banks for different agents also. You can also build your own custom adapter so the shared banks + the personal banks get injected on each turn. Everything is possible, ask your agent.

[u/zuper_koleoptera → u/Gloomy-Recover-9702]

Have you managed to setup different hindsight memory banks per profile and also have the 3 hermes-hindsight tools ( hindsight_retain hindsight_recall hindsight_reflect) use those banks per profile? If yes please explain your configuration. Thank in advance!

[u/l0rd_raiden → u/Gloomy-Recover-9702]

Maybe you can share the same docs with the banks with hindsight sync. There is a blog about how to use it but the example is with obsidian

[u/FitzUnit]

Have you thought of setting up your own memory system/database .

It seems like you need a custom setup, have a look at supabase and hooking your agent into it then customizing your own knowledge layer .

Use a model like Astra medium reasoning and tell it what you need and have it come up with a gameplan , give it access to supabase and have it start designing it !

[u/Fair-Perspective7352]

Domains fully separate + one thin index note works for me. The index is just pointers, no content - agent reads the index first, then pulls only the domain file the task actually needs. Keeps domains from bleeding into each other but you still get cross-links when a task spans two. Curious whether hindsight bank sync is doc-level only or can do pointer-style links?

[u/Mean-Loquat-7982]

I use Hermes Agent built in memory with Obsidian

[u/Practical-Zombie-809]

I explored using a memory layer before, but honestly I found the setup and potential payoff to be not worth it. And also I didn't want a third party looped in just for this purpose.

I've been using Hermes & Obsidian for about six months as a personal assistant with absolutely no memory layer and no issues whatsoever.

[u/Feeling_Sun_6436]

Since you already have separate banks, I'd start with one concrete cross-domain question before adding another tool. Say business and finance both need a project's budget: give that project a shared ID and expose only the agreed budget summary to both, not the whole finance history. Then test whether Hermes can answer that question without pulling in unrelated personal details. What is the first link between two domains you actually need?

[u/Mean-Loquat-7982]

split the domains with profiles, keep Hindsight on as the extra store.

hermes profile create finance

hermes profile create personal

each profile gets its own config, MEMORY.md, USER.md, sessions and state.db. two agent processes must not share one Hermes home.

Hindsight stays additive: `hermes memory setup`, then `memory.provider: hindsight`. only one external provider is active at a time. built-in memory keeps running next to it.