Multimodal Agent MemorySubmit a paper

Auto-scaling Continuous Memory

Auto-scaling Continuous Memory for GUI Agent

Wenyi Wu, Kun Zhou, Ruoxin Yuan, Vivian Yu, Stephen Wang, Zhiting Hu, et al. · 2025-10-10

Management
T1 Static Memory
Memory is built once and reused without change during deployment.
Primary modality
GUI & computer use
Also: text
Representation
Internalized latent & parametric

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. continuous GUI trajectory memory

    1. Represented asPersistent multimodal latent stateInternalized latent & parametric
    2. Stored inVector-indexed collection
    3. Retrieved bySimilarity search, Latent / parametric activation
    4. Source evidenceSource not retained
    GUI trajectories are encoded into fixed-length continuous embeddings and injected directly into the VLM.Full paper: Memory Size (log scale) · PDF p. 2 · Figure 1

Related systems