Multimodal Agent MemorySubmit a paper

RoboOS-NeXT

RoboOS-NeXT: A Unified Memory-based Framework for Lifelong, Scalable, and Robust Multi-Robot Collaboration

Huajie Tan, Cheng Chi, Xiansheng Chen, Yuheng Ji, Zhongxia Zhao, Xiaoshuai Hao, et al. · 2025-10-30

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Embodied & 3D
Also: text
Representation
Hybrid
Distinct operative representation paths are deliberately linked or jointly consumed by downstream reasoning, generation, or control.

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. Spatial-Embodiment Memory

    1. Represented asModality-specific encodings & geometric stateSource- and modality-specific
    2. Stored inGraph / relational store
    3. Retrieved byMetadata / spatiotemporal retrieval, Structure traversal
    4. Source evidenceRetained but not accessible to the agent
    STEM is updated from mapping, tool-calling feedback, task execution, and robot state changes.; Task/event history is written into temporal memory.; Robot embodiment/capability state is written into embodiment memory.. spatial query over the map conditioned on current observation and instruction.Full paper: III. METHOD · PDF p. 3 · Figure 1 / method overview

  2. Temporal-Embodiment Memory

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inGraph / relational store
    3. Retrieved byMetadata / spatiotemporal retrieval, Structure traversal
    4. Source evidenceSource not retained
    STEM is updated from mapping, tool-calling feedback, task execution, and robot state changes.; Task/event history is written into temporal memory.; Robot embodiment/capability state is written into embodiment memory.. spatial query over the map conditioned on current observation and instruction.Full paper: III. METHOD · PDF p. 3 · Figure 1 / method overview

How memory changes (T2 operations)

  • Update · Rule-based update

    During operation, RoboOS-NeXT applies fixed-rule insertion or replacement to Spatial-Embodiment Memory; the memory state changes while the governing update policy remains fixed.

  • Revision · Rule-based state correction

    During operation, RoboOS-NeXT applies fixed-rule correction of stored state to Spatial-Embodiment Memory; the memory state changes while the governing update policy remains fixed.

  • Reorganization · Relinking & reindexing

    During operation, RoboOS-NeXT applies relinking or reindexing of stored items to Spatial-Embodiment Memory; the memory state changes while the governing update policy remains fixed.

  • Forgetting · Discrete eviction

    During operation, RoboOS-NeXT applies explicit deletion or eviction of stored items to Spatial-Embodiment Memory; the memory state changes while the governing update policy remains fixed.

Related systems