Multimodal Agent MemorySubmit a paper

BrainNav

Endowing Embodied Agents with Spatial Reasoning Capabilities for Vision-and-Language Navigation

Qianqian Bai, Zhongpu Chen, Ling Luo, Huaming Du, Yuqian Lei, Ziyun Jiao · 2026-03-02

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Embodied & 3D
Also: text
Representation
Hybrid
Distinct operative representation paths are deliberately linked or jointly consumed by downstream reasoning, generation, or control.

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. trajectory / map memory

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inGraph / relational store, Hierarchical multi-tier store
    3. Retrieved bySimilarity search, Structure traversal
    4. Source evidenceSource not retained
    Stores experienced paths, topological maps and coordinate maps during exploration. retrieves topological maps and historical trajectories; exact matches can reuse paths.Full paper: 3.1. Hippocampal Memory Center · PDF p. 9 · Figure 1 / method overview

  2. trajectory / map memory

    1. Represented asExperience-conditioned parametric memoryInternalized latent & parametric
    2. Stored inModular adapter bank, Graph / relational store
    3. Retrieved bySimilarity search, Structure traversal, Latent / parametric activation
    4. Source evidenceSource not retained
    Stores experienced paths, topological maps and coordinate maps during exploration. retrieves topological maps and historical trajectories; exact matches can reuse paths.Full paper: 3.1. Hippocampal Memory Center · PDF p. 9 · Figure 1 / method overview

How memory changes (T2 operations)

  • Update · Rule-based update

    During operation, BrainNav applies fixed-rule insertion or replacement to trajectory / map memory; the memory state changes while the governing update policy remains fixed.

  • Reorganization · Relinking & reindexing

    Spatial representation updates during real-world navigation. For BrainNav, this specifically supports relinking or reindexing of stored items of trajectory / map memory.

Related systems