Multimodal Agent MemorySubmit a paper

Omni-SimpleMem

Omni-SimpleMem: Autoresearch-Guided Discovery of Lifelong Multimodal Agent Memory

Jiaqi Liu, Zipeng Ling, Shi Qiu, Yanqing Liu, Siwei Han, Peng Xia, et al. · 2026-04-02

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Image
Also: text
Representation
Hybrid
Distinct operative representation paths are deliberately linked or jointly consumed by downstream reasoning, generation, or control.

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. unified multimodal memory system discovered through autonomous experiments

    1. Represented asModality-specific encodings & geometric stateSource- and modality-specific
    2. Stored inVector-indexed collection
    3. Retrieved bySimilarity search, Planner / tool-assisted retrieval
    4. Source evidenceSource not retained
    Architectural components, prompts, retrieval strategies, and data-pipeline fixes selected by an autonomous research loop. retrieval and prompting are optimized by the discovered system for multimodal memory benchmarks.Full-paper method / memory representation and retrieval · PDF p. 2 · Figure 1 / method overview

  2. retrieved facts and memory-management prompts/pipelines

    1. Represented asPerception-to-text records & summariesCross-represented explicit
    2. Stored inVector-indexed collection
    3. Retrieved bySimilarity search, Planner / tool-assisted retrieval
    4. Source evidenceSource not retained
    Architectural components, prompts, retrieval strategies, and data-pipeline fixes selected by an autonomous research loop. retrieval and prompting are optimized by the discovered system for multimodal memory benchmarks.Full-paper method / memory representation and retrieval · PDF p. 2 · Figure 1 / method overview

How memory changes (T2 operations)

  • Update · Rule-based update

    During operation, Omni-SimpleMem applies fixed-rule insertion or replacement to unified multimodal memory system discovered through autonomous experiments; the memory state changes while the governing update policy remains fixed.

  • Consolidation · Merging & deduplication

    During operation, Omni-SimpleMem applies merging or deduplication of overlapping entries to unified multimodal memory system discovered through autonomous experiments; the memory state changes while the governing update policy remains fixed.

  • Reorganization · Relinking & reindexing

    During operation, Omni-SimpleMem applies relinking or reindexing of stored items to unified multimodal memory system discovered through autonomous experiments; the memory state changes while the governing update policy remains fixed.

Related systems