Multimodal Agent MemorySubmit a paper

RenderMem

RenderMem: Rendering as Spatial Memory Retrieval

JooHyun Park, HyeongYeop Kang · 2026-03-15

Read the paperPDF

Management
T1 Static Memory
Memory is built once and reused without change during deployment.
Primary modality
Embodied & 3D
Also: text
Representation
Source- and modality-specific

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. 3D scene memory

    1. Represented asModality-specific encodings & geometric stateSource- and modality-specific
    2. Stored inFlat sequential records
    3. Retrieved byPlanner / tool-assisted retrieval
    4. Source evidenceSource not retained
    A persistent 3D representation renders query-conditioned evidence from arbitrary viewpoints for visibility and occlusion reasoning.Full paper: Method · PDF p. 5 · Figure 1

Related systems