Multimodal Agent MemorySubmit a paper

Vlogger

Vlogger: Make Your Dream A Vlog

Shaobin Zhuang, Kunchang Li, Xinyuan Chen, Yaohui Wang, Ziwei Liu, Yu Qiao, et al. · 2024-01-17

Read the paperPDF

Management
T1 Static Memory
Memory is built once and reused without change during deployment.
Primary modality
Video & streaming
Also: text, Image
Representation
Source- and modality-specific

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. Fixed character/scene reference images reused per segment

    1. Represented asRetained perceptual source evidenceSource- and modality-specific
    2. Stored inFlat sequential records
    3. Retrieved byLatent / parametric activation
    4. Source evidenceSource directly available
    Reference images (Actor stage). Reference images are reused for every video segment.Full-paper method / memory representation and retrieval · PDF p. 2 · Figure 1 / method overview

Related systems