Multimodal Agent MemorySubmit a paper

Embodied-SlotSSM

Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective

Nhat Chung, Taisei Hanyu, Toan Nguyen, Huy Le, Frederick Bumgarner, Duy Minh Ho Nguyen, et al. · 2026-01-01

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Embodied & 3D
Also: text
Representation
Internalized latent & parametric

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. object-centric slot state

    1. Represented asPersistent multimodal latent stateInternalized latent & parametric
    2. Stored inFlat sequential records
    3. Retrieved byLatent / parametric activation
    4. Source evidenceSource not retained
    Spatiotemporally consistent slot identities carry object-specific interaction history into action decoding.Full-paper method / memory representation and retrieval · PDF p. 6 · Figure 1

How memory changes (T2 operations)

  • Update · Learned update module

    A slot state-space model recurrently updates object-centric memory across manipulation frames. For Embodied-SlotSSM, this specifically supports a trained but frozen update module of object-centric slot state.

Related systems