Multimodal Agent MemorySubmit a paper

ScrapMem

ScrapMem: Multimodal Scrapbook Memory for Long-Horizon Agents

Jiale Chang, Yuxiang Ren · 2026-05-05

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Image
Also: text
Representation
Hybrid
Distinct operative representation paths are explicitly linked for downstream retrieval, reasoning, or control.

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. Scrapbook Pages

    1. Represented asRetained perceptual source evidenceSource- and modality-specific
    2. Stored inHierarchical multi-tier store
    3. Retrieved bySimilarity search, Metadata / spatiotemporal retrieval
    4. Source evidenceSource directly available
    Scrapbook pages retain perceptual snippets while progressively reducing their optical fidelity.Full paper: Method: ScrapMem · PDF p. 4 · Figure 1

  2. episodic memory graph

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inGraph / relational store
    3. Retrieved byStructure traversal
    4. Source evidenceSource linked & recoverable
    A causal-temporal episodic graph links retained scraps into searchable events.Full paper: Method: ScrapMem · PDF p. 4 · Figure 1

How memory changes (T2 operations)

  • Forgetting · Progressive decay

    Optical forgetting lowers page resolution as memories age. For ScrapMem, this specifically supports progressive decay of stored importance or retention of Scrapbook Pages.

  • Reorganization · Relinking & reindexing

    New scraps are integrated into the causal-temporal episode graph. For ScrapMem, this specifically supports relinking or reindexing of stored items of Scrapbook Pages.

Related systems