Multimodal Agent MemorySubmit a paper

VideoLucy

VideoLucy: Deep Memory Backtracking for Long Video Understanding

Jialong Zuo, Yongtai Deng, Lingdong Kong, Jingkang Yang, Rui Jin, Yiwei Zhang, et al. · 2025-10-14

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Video & streaming
Also: text
Representation
Source- and modality-specific

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. hierarchical video memory

    1. Represented asRetained perceptual source evidenceSource- and modality-specific
    2. Stored inHierarchical multi-tier store
    3. Retrieved byMetadata / spatiotemporal retrieval, Planner / tool-assisted retrieval
    4. Source evidenceSource directly available
    Progressive memory depths retain increasingly fine temporal video evidence for iterative backtracking.Full paper: Fine Memory · PDF pp. 4–5 · Figure 1

How memory changes (T2 operations)

  • Update · Prompted LLM/VLM record update

    During operation, VideoLucy applies LLM-mediated memory editing to hierarchical video memory; the memory state changes while the governing update policy remains fixed.

  • Consolidation · Episodic / hierarchical summarization

    During operation, VideoLucy applies episodic or hierarchical summarization to hierarchical video memory; the memory state changes while the governing update policy remains fixed.

Related systems