Multimodal Agent MemorySubmit a paper

TAME

TAMEing Long Contexts in Personalization: Towards Training-Free and State-Aware MLLM Personalized Assistant

Rongpei Hong, Jian Lang, Ting Zhong, Yong Wang, Fan Zhou · 2025-12-25

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Image
Also: text
Representation
Cross-represented explicit

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. dynamic and static concept attributes

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inHierarchical multi-tier store
    3. Retrieved bySimilarity search, Planner / tool-assisted retrieval
    4. Source evidenceSource linked & recoverable
    Dynamic State and Static Personalized memories store concept-aligned transient and persistent attributes.Full paper: Retrieval-Augmented Generation · PDF p. 3 · Figure 1

How memory changes (T2 operations)

  • Reorganization · Memory-level migration (short- to long-term)

    Stable attributes migrate to static memory. For TAME, this specifically supports migration between memory tiers of dynamic and static concept attributes.

  • Forgetting · Discrete eviction

    The bounded dynamic tier removes outdated attributes. For TAME, this specifically supports explicit deletion or eviction of stored items of dynamic and static concept attributes.

  • Update · Prompted LLM/VLM record update

    A frozen multimodal language model chooses Add, Modify, or Remove actions over concept attributes. For TAME, this specifically supports LLM-mediated memory editing of dynamic and static concept attributes.

  • Revision · LLM-based conflict resolution

    The same fixed manager compares incoming concept evidence with stored attributes and resolves inconsistent or outdated entries through Modify or Remove. For TAME, this specifically supports LLM-based resolution of conflicting records of dynamic and static concept attributes.

Related systems