Multimodal Agent MemorySubmit a paper

MIRIX

MIRIX: Multi-Agent Memory System for LLM-Based Agents

Yu Wang, Xi Chen · 2025-07-10

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
GUI & computer use
Also: Image, text
Representation
Hybrid
Distinct operative representation paths are explicitly linked for downstream retrieval, reasoning, or control.

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. screens and verbatim resources

    1. Represented asRetained perceptual source evidenceSource- and modality-specific
    2. Stored inHierarchical multi-tier store
    3. Retrieved byPlanner / tool-assisted retrieval
    4. Source evidenceSource directly available
    Resource Memory and the Knowledge Vault retain files, screenshots, and protected evidence.Full-paper method / memory representation and retrieval · PDF p. 2 · Figure 1

  2. core, episodic, semantic and procedural records

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inGraph / relational store, Hierarchical multi-tier store
    3. Retrieved bySimilarity search, Planner / tool-assisted retrieval
    4. Source evidenceSource linked & recoverable
    Specialized managers maintain structured facts, events, relations, and procedures.Full-paper method / memory representation and retrieval · PDF p. 2 · Figure 1

  3. natural-language summaries, event details, procedures, document excerpts, and profiles

    1. Represented asPerception-to-text records & summariesCross-represented explicit
    2. Stored inHierarchical multi-tier store, Vector-indexed collection
    3. Retrieved bySimilarity search, Planner / tool-assisted retrieval
    4. Source evidenceSource linked & recoverable
    Specialized managers create natural-language summaries and records, and retrieved entries are supplied downstream as labeled text with links to retained resources.Full-paper method / memory representation and retrieval · PDF p. 2 · Figure 1

How memory changes (T2 operations)

  • Update · Prompted LLM/VLM record update

    Specialized managers add and revise records under fixed roles. For MIRIX, this specifically supports LLM-mediated memory editing of screens and verbatim resources.

  • Consolidation · Episodic / hierarchical summarization

    Histories are compressed into specialized summaries. For MIRIX, this specifically supports episodic or hierarchical summarization of screens and verbatim resources.

Related systems