Multimodal Agent MemorySubmit a paper

ObsMem

WorldLines: Benchmarking and Modeling Long-Horizon Stateful Embodied Agents

Yehang Zhang, Jianchong Su, Haojian Huang, Yifan Chang, Tianhao Zhou, Xinli Xu, et al. · 2026-08-21

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Embodied & 3D
Also: Image, text
Representation
Cross-represented explicit

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. visibility-aware memories and action-native state trails

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inGraph / relational store, Flat sequential records
    3. Retrieved byMetadata / spatiotemporal retrieval, Structure traversal
    4. Source evidenceSource not retained
    ObsMem tracks visibility, action history, and changing household state for embodied planning.Full paper: Method · PDF p. 16

How memory changes (T2 operations)

  • Revision · Rule-based state correction

    State trails update overwritten world states under partial observability. For ObsMem, this specifically supports fixed-rule correction of stored state of visibility-aware memories and action-native state trails.

  • Reorganization · Relinking & reindexing

    Evidence-linked state records are connected across dialogue and action traces. For ObsMem, this specifically supports relinking or reindexing of stored items of visibility-aware memories and action-native state trails.

Related systems