memtrix:~$ ./start _

harness that
remembers everything.

Not a chatbot. An agent that runs on hardware you own.

It searches the web, runs tools, curates its own memory, and shapes its persona around how you talk to it. Self hosted, private by default, fully yours.

memtrix:~ zsh
$ docker compose up -d
[ok] conduit matrix homeserver :6167
[ok] chroma vector store :8000
[ok] searxng private web search internal
[ok] web control panel :8800
[ok] memtrix agent online
 
~ agent ready. invite @memtrix:memtrix.local
> remember the postgres creds i sent you?
memtrix: yep. stored them in your user card
on apr 02. want me to pull them up? _
what it does

Your personal AI, on your own metal.

Private by default. No cloud dependency. The model, homeserver, search engine, and vector store all run on a machine you control.

01

fully self hosted

Model, Matrix homeserver, search engine, and vector store all run on your hardware. Your data never leaves the box.

02

persistent memory

Every conversation is saved and embedded for on-device search. Recall a chat from weeks ago by meaning - or pull up a whole day or week by date.

03

reasoning memory

A background deriver distills conversations into confidence-scored conclusions and auto-curated profile cards. It also learns about the people, projects, and places you mention and tracks dated events, surfacing upcoming ones proactively. Only relevant memories are recalled, contradictions resolve to the stronger fact, and weak ones decay over time.

04

agentic tools

41 built-in tools on an iterative reasoning loop. Web search, files, git, downloads, email with a reactive inbox, SSH remote admin with file transfer, self-authored skills, background workers. Drop a Python file in to add your own.

05

multi provider llms

Run local models through Ollama, reach 200+ cloud models via OpenRouter, or point at any OpenAI-compatible endpoint. Discover available models from the panel and swap providers with one config change. Give any model a price and /costs tracks token-based spend for it.

06

multi agent system

Spin up specialist sub-agents with their own identity, memory, and Matrix presence - from chat or the control panel. They can consult each other on their own.

07

web control panel

A local panel at localhost:8800. Edit config, test connections, manage secrets, and curate memory without touching JSON.

08

security hardened

Non-root container, read-only root filesystem, all capabilities dropped, SSRF guards, and human-in-the-loop on destructive ops. Web search and fetched page content is screened for prompt injection by a local classifier before it reaches the model.

09

private web search

A built-in SearXNG instance for searches that do not phone home. Fetch, read, and summarize any URL, fully self hosted.

10

self documenting

Ask how Memtrix works and it answers from its own docs. The search_docs and ask_docs tools research the bundled documentation, with sources.

11

ssh remote admin

Acts as a sysadmin over SSH: its own key, a persistent shell where state persists between commands, trust-on-first-use host keys, and confirmation for destructive commands.

12

self-authored skills

Memtrix learns from multi-step tasks and captures reusable workflows as skills. On future requests it sees a catalog of all its skills and loads the relevant ones on demand.

13

vision

Flip on a model's vision toggle and Memtrix sees the images you send it — describing, reading, and reasoning over pictures directly. Works across Ollama, OpenRouter, and any OpenAI-compatible endpoint.

quickstart

Up and running in minutes.

Clone, configure, launch. The setup script and onboarding wizard handle the rest.

install.sh
# clone and enter the project
$ git clone https://github.com/nnxmms/Memtrix.git && cd memtrix
 
# create dirs, build the image, start the homeserver
$ ./setup.sh
 
# interactive wizard: provider, model, channel
$ ./onboard.sh
 
# launch the whole stack
$ docker compose up -d

then open Element, connect to localhost:6167, and invite @memtrix:memtrix.local to a room. Prefer a UI? Open localhost:8800.

architecture

Built from purpose-built parts.

Every component runs locally in Docker on a private network. Only the control panel is published, bound to localhost.

memtrix agent

The Python agent. Orchestrates model calls, tool execution, memory, sessions, and sub-agent management.

web :8800

FastAPI backend plus a React control panel for config, secrets, connection tests, and memory administration.

chroma :8000

Standalone vector store shared by the agent and the panel. Powers semantic recall and reasoning memory.

conduit :6167

Lightweight Matrix homeserver, local only and no federation. Swappable for any external homeserver.

searxng internal

Privacy-respecting metasearch engine for web access. Self hosted, no tracking, no leaks.

ollama / openrouter / openai-compatible llm

Local inference through Ollama, 200+ cloud models via OpenRouter, or any OpenAI-compatible endpoint (llama.cpp, vLLM, LM Studio, OpenAI) when you need the extra reach.

built-in tools

41 tools. Auto-discovered. Extensible.

Every tool is a drop-in Python file. Add one and the agent picks it up on the next restart.

40 built-in 0 shell access 25 max reasoning iterations
memory system

Layered memory. Total recall.

Searchable conversation history captures everything verbatim. A reasoning layer distills durable knowledge into auto-curated cards.

conversation memory

sessions/ → vector store

Every conversation is saved as a raw transcript, chunked, and embedded on-device with nomic-embed-text-v1.5 so the agent can search its whole history — by meaning, or by a specific day or date range. No journaling by hand — a persistent hash cache means restarts re-embed only new chunks.

reasoning memory

USER.md

A background deriver turns raw chat into confidence-scored conclusions about you, then re-curates a compact profile card. Only relevant memories are injected, a nightly pass resolves contradictions and lets weak facts decay, and the agent reads the card every turn but cannot overwrite it by hand. The persona genuinely evolves.

run it from the browser

The web control panel lets you edit config, test connections, rotate secrets, and browse or edit memory, then apply changes with a safe restart.

localhost:8800 ›
memtrix:~$ ./meet-your-agent

Self-host an AI that is actually yours.

Private, persistent, and entirely under your control. No subscriptions, no telemetry, no data leaving your machine.