Multimodal Agent MemorySubmit a paper

TGL Proactive Trigger and Routing

Do Proactive Agents Really Need an LLM to Decide When to Wake and What to Anchor?

Xiaoze Liu, Ruowang Zhang, Amir H. Abdi, Michel Galley, Zhikai Chen, Siheng Xiong, et al. · 2026-05-28

Read the paperPDF

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
GUI & computer use
Also: text
Representation
Cross-represented explicit

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. causal heterogeneous temporal graph of session events and the files, applications, URLs, queries, and type entities they touch

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inGraph / relational store
    3. Retrieved byStructure traversal
    4. Source evidenceSource linked & recoverable
    At decision time t, observed activity history through t is represented as a heterogeneous temporal graph. Event nodes are linked to named files, applications, URLs, queries, and type nodes, while directional temporal edges connect consecutive events; these named entities remain recoverable and are routed as structured evidence to the downstream agent.Full paper: Sec. 3 Problem Formulation and Sec. 4 Method · PDF p. 3 · Figure 2
    Inference removes backward temporal edges so each trigger and routing decision depends only on the current event and prior events in its session, making the accumulated session graph a causal operative state rather than future-aware evaluation context.Full paper: Appendix B.1, What the Graph Network Actually Sees · PDF p. 16 · Appendix B.1 graph schema

How memory changes (T2 operations)

  • Update · Rule-based update

    Structured activity events are deterministically converted into event, entity, type, and temporal-edge updates under the same fixed graph-construction rules at training and inference. Each later event therefore extends the causal session graph that the TGL trigger and routing heads read on subsequent decisions.

Related systems