Seeing, Maintaining, and LearningThe Evolution of Multimodal Agent Memory
Memory · Observatory
- memory systems
- 297
- benchmarks
- 82
- modalities
- 5
01 /System scan
VISTA: A Visual Harness for Reasoning in an Interactive World
- Retained source evidence
- Hierarchical multi-tier store
- Planner / tool-assisted retrieval
Latest systems
- 2026-10 VISTA
- 2026-08 VoiceMem
- 2026-08 WnW (Waxing-and-Waning KV Cache)
- 2026-08 FinAcumen (Financial Memory + Financial Tools harness)
- 2026-08 Stateful Streaming ASR (State Carry-over / State Rollback)
- 2026-08 ObsMem
- 2026-08 GeoForge
- 2026-08 StreamFlow
02 /Memory sphereone arm per modality, time along the arm
Drag to rotate · click a point to open it
03 /Representation spectrumsystems per stored form
04 /Management ladderwhat can change
05 /Paper riverevery system by publication date
06 /Frontier spotlightthe newest self-evolving systems
T3 Self-Evolving Memory · 2026-08-11
GeoForgeGeoForge: Non-Parametric Self-Evolving Agents for Earth-Observation Reasoning
Evolves its retrieval policy · stores memory as structured records & graphs, text records & summaries
Image
Find your way in
Start from the question you have. Each view uses the same corpus.
- Axis I · RepresentationWhat does stored memory look like?Six representation forms in three families, and the hybrids that combine them.
- Axis I · FormationHow does experience become memory?From pixels and speech to records, graphs, states, and weights, traced across the corpus.
- Axis II · Memory ManagementWhat can change while the agent runs?Static, dynamic, and self-evolving memory, with interactive walk-throughs.
- ModalitiesI work on one modality.Systems and benchmarks for image, video, audio, GUI, or embodied agents.
Or jump to a modality: ImageVideo & streamingAudio & speechGUI & computer useEmbodied & 3D
What the corpus shows
68.7% of systems update memory through a stable management policy (T2).
T2 Dynamic Memory is the norm. Only 17 systems let feedback change the policy itself.
See the tiers46.8% of systems are hybrids.
Most pair explicit records with source-level evidence or modality-specific encodings.
See hybrid patterns17 of 17 self-evolving systems keep explicit memory.
Policies evolve where memory can be read and edited; none of the source-only or latent/parametric-only systems do.
See the matrix7 of 82 benchmarks directly test conflicting memories.
Evaluation favors finding old evidence over resolving conflicting or outdated memories.
See benchmark coverage
Cite the survey
Guo et al. (2026). Seeing, Maintaining, and Learning: The Evolution of Multimodal Agent Memory. arXiv:2610.19366.