MemPalace

    MemPalace/mempalace

    #982 this week

    The best-benchmarked open-source AI memory system. And it's free.

    ai
    llm
    chromadb
    mcp
    memory
    python
    Python
    MIT
    57.1K stars
    7.4K forks
    57.1K GitHub watchers
    Updated 7/9/2026
    View on GitHub

    Backblaze Generative Media Hackathon

    Build the next generation of AI media apps with Genblaze, stored on Backblaze B2. $10,000 in prizes.

    Enter the hackathon

    Loading star history...

    Use Cases & Benefits

    • Implements a local-first AI memory system that stores and retrieves conversation history verbatim using semantic search with a structured index.
    • Offers high retrieval recall without requiring any API calls or cloud services, ensuring privacy and offline capability.
    • Use for managing and searching large personal or project conversation histories with scoped semantic queries.
    • Use for integrating a pluggable vector-store backend in AI applications to customize memory storage and retrieval.
    • Use for enhancing AI agents and tools with persistent, structured memory and temporal knowledge graph capabilities.

    About mempalace

    MemPalace

    MemPalace

    Local-first AI memory. Verbatim storage, pluggable backend, 96.6% R@5 raw on LongMemEval — zero API calls.

    [!CAUTION] Beware of impostor sites. MemPalace has no other official websites. The only official sources are this GitHub repository, the PyPI package, and the docs at mempalaceofficial.com. Any other domain (including .tech, .net, or other .com variants) is an impostor and may distribute malware. Details and timeline: docs/HISTORY.md.

    [!IMPORTANT] Claude Code sessions expire in 30 days without auto-save hooks wired. Read this →

    Need the shortest recovery/setup path? Use the Claude Code retention setup checklist.


    What it is

    MemPalace stores your conversation history as verbatim text and retrieves it with semantic search. It does not summarize, extract, or paraphrase. The index is structured — people and projects become wings, topics become rooms, and original content lives in drawers — so searches can be scoped rather than run against a flat corpus.

    The retrieval layer is pluggable. The current default is ChromaDB; the interface is defined in mempalace/backends/base.py and alternative backends can be dropped in without touching the rest of the system.

    Nothing leaves your machine unless you opt in.

    Architecture, concepts, and mining flows: mempalaceofficial.com/concepts/the-palace.


    Install

    MemPalace ships a CLI, so install it in an isolated environment to avoid PEP 668 errors on Debian/Ubuntu/Homebrew Pythons and to keep mempalace's deps (chromadb, numpy, grpcio, …) from conflicting with anything else in your global site-packages.

    We recommend uvuv tool install puts the mempalace CLI in an isolated environment on your PATH:

    uv tool install mempalace
    mempalace init ~/projects/myapp
    

    pipx works the same way if you prefer it: pipx install mempalace.

    Prefer plain pip only inside an activated virtualenv where you explicitly want import mempalace available:

    python -m venv .venv && source .venv/bin/activate
    pip install mempalace
    

    Docker

    A container image is also available for running the MCP server or the CLI without a local Python toolchain. Everything persists under /data (palace, config, and the cached embedding model), so mount a volume there.

    # Build the image (CPU; bundles the `extract` + `spellcheck` extras)
    docker build -t mempalace .
    
    # MCP server over stdio — note the `-i` flag (JSON-RPC needs stdin)
    docker run -i --rm -v mempalace-data:/data mempalace
    
    # Run any CLI command instead (mount the host directory you want to mine)
    docker run --rm -v mempalace-data:/data -v /path/to/project:/work mempalace mine /work
    docker run --rm -v mempalace-data:/data mempalace search "why GraphQL"
    

    Wire it into an MCP client (e.g. Claude Code) as a stdio server:

    {
      "mcpServers": {
        "mempalace": {
          "command": "docker",
          "args": ["run", "-i", "--rm", "-v", "mempalace-data:/data", "mempalace"]
        }
      }
    }
    

    docker compose run --rm mcp works too (see docker-compose.yml). For CUDA-accelerated embeddings, build the GPU variant with docker build -f Dockerfile.gpu -t mempalace:gpu . and run it with --gpus all. Customise the bundled extras at build time, e.g. docker build --build-arg EXTRAS="extract,spellcheck" -t mempalace ..

    Storage backends

    ChromaDB is the default. For the pluggable-backend preview, MemPalace also ships sqlite_exact for local exact-vector correctness checks, and two opt-in external service backends — qdrant (REST) and pgvector (Postgres). The two external backends exercise the storage contract on different substrates (a REST/dict store and a SQL/JSONB store), so it is not accidentally shaped around one vendor.

    # local no-service backend
    mempalace mine ~/projects/myapp --backend sqlite_exact
    
    # Qdrant backend, defaulting to http://localhost:6333
    MEMPALACE_QDRANT_URL=http://localhost:6333 \
      mempalace mine ~/projects/myapp --backend qdrant
    
    # Postgres + pgvector backend, defaulting to postgresql://localhost:5432/mempalace
    #   needs the optional driver: pip install mempalace[pgvector]
    #   and the `vector` extension available on the server
    MEMPALACE_PGVECTOR_DSN=postgresql://localhost:5432/mempalace \
      mempalace mine ~/projects/myapp --backend pgvector
    

    Qdrant can also be configured with MEMPALACE_QDRANT_API_KEY, MEMPALACE_QDRANT_NAMESPACE, and MEMPALACE_QDRANT_TIMEOUT; pgvector with MEMPALACE_PGVECTOR_NAMESPACE. Both external backends isolate tenants by namespace (advertised via the supports_namespace_isolation capability) and write a local marker (qdrant_backend.json / pgvector_backend.json) to guard against silently opening a palace against the wrong server.

    When MEMPALACE_QDRANT_URL or MEMPALACE_PGVECTOR_DSN points anywhere other than your own local or trusted self-hosted service, MemPalace will send and store verbatim drawer text and metadata there. That is an explicit opt-in backend choice, never the default.

    Quickstart

    # Mine content into the palace
    mempalace mine ~/projects/myapp                    # project files
    mempalace mine ~/.claude/projects/ --mode convos   # Claude Code sessions (scope with --wing per project)
    
    # Search
    mempalace search "why did we switch to GraphQL"
    
    # Load context for a new session
    mempalace wake-up
    

    For Claude Code, Gemini CLI, Antigravity, MCP-compatible tools, and local models, see mempalaceofficial.com/guide/getting-started.


    Benchmarks

    All numbers below are reproducible from this repository with the commands in benchmarks/BENCHMARKS.md. Full per-question result files are committed under benchmarks/results_*.

    LongMemEval — retrieval recall (R@5, 500 questions):

    ModeR@5LLM required
    Raw (semantic search, no heuristics, no LLM)96.6%None
    Hybrid v4, held-out 450q (tuned on 50 dev, not seen during training)98.4%None
    Hybrid v4 + LLM rerank (full 500)≥99%Any capable model

    The raw 96.6% requires no API key, no cloud, and no LLM at any stage. The hybrid pipeline adds keyword boosting, temporal-proximity boosting, and preference-pattern extraction; the held-out 98.4% is the honest generalisable figure.

    The rerank pipeline promotes the best candidate out of the top-20 retrieved sessions using an LLM reader. It works with any reasonably capable model — we have reproduced it with Claude Haiku, Claude Sonnet, and minimax-m2.7 via Ollama Cloud (no Anthropic dependency). The gap between raw and reranked is model-agnostic; we do not headline a "100%" number because the last 0.6% was reached by inspecting specific wrong answers, which benchmarks/BENCHMARKS.md flags as teaching to the test.

    Other benchmarks (full results in benchmarks/BENCHMARKS.md):

    BenchmarkMetricScoreNotes
    LoCoMo (session, top-10, no rerank)R@1060.3%1,986 questions
    LoCoMo (hybrid v5, top-10, no rerank)R@1088.9%Same set
    ConvoMem (all categories, 250 items)Avg recall92.9%50 per category
    MemBench (ACL 2025, 8,500 items)R@580.3%All categories

    We deliberately do not include a side-by-side comparison against Mem0, Mastra, Hindsight, Supermemory, or Zep. Those projects publish different metrics on different splits, and placing retrieval recall next to end-to-end QA accuracy is not an honest comparison. See each project's own research page for their published numbers.

    Reproducing every result:

    git clone https://github.com/MemPalace/mempalace.git
    cd mempalace
    uv sync --extra dev   # or: pip install -e ".[dev]"
    # see benchmarks/README.md for dataset download commands
    uv run python benchmarks/longmemeval_bench.py /path/to/longmemeval_s_cleaned.json
    

    Knowledge graph

    MemPalace includes a temporal entity-relationship graph with validity windows — add, query, invalidate, timeline — backed by local SQLite. Usage and tool reference: mempalaceofficial.com/concepts/knowledge-graph.

    MCP server

    35 MCP tools cover palace reads/writes, knowledge-graph operations, cross-wing navigation, drawer management, and agent diaries. Installation and the full tool list: mempalaceofficial.com/reference/mcp-tools.

    Agents

    Each specialist agent gets its own wing and diary in the palace. Discoverable at runtime via mempalace_list_agents — no bloat in your system prompt: mempalaceofficial.com/concepts/agents.

    Auto-save hooks

    Auto-save hooks for Claude Code, Codex CLI, and Cursor IDE save periodically and before context compression:

    If you are installing under time pressure, start with the Claude Code retention setup checklist: wire the hooks, back up existing JSONL transcripts, and backfill them with mempalace mine ~/.claude/projects/ --mode convos.

    For per-message recall on top of the file-level chunks the hooks produce, run mempalace sweep <transcript-dir> periodically — it stores one verbatim drawer per user/assistant message, idempotent and resume-safe.


    Requirements

    • Python 3.9+
    • A vector-store backend (ChromaDB by default)
    • ~300 MB disk for the embedding model. Onboarding (python -m mempalace.onboarding) offers embeddinggemma-300m (multilingual, 100+ languages, recommended) or all-MiniLM-L6-v2 (English-only, ~30 MB). See the docstring at mempalace/embedding.py for details and migration notes.

    No API key is required for the core benchmark path.

    Docs

    Contributing

    PRs welcome. See CONTRIBUTING.md.

    License

    MIT — see LICENSE.

    Discover Repositories

    Search across tracked repositories by name or description