Multimodal Agent MemorySubmit a paper

Axis II · Memory Management

What can change while the agent is running?

The survey separates systems by the scope of change they allow during deployment. In T1, memory is fixed after it is built. In T2, memory is updated through a stable management policy. In T3, feedback also evolves that policy.

Policy π

No write or maintenance policy after formation.

Try a question, then change the world and ask again.

Memory M (fixed)

  • Kitchen & living-room map
  • Mug — counter
  • Keys — hallway table
  • User drinks tea at 8am
  • Charging dock — living room

Where the 297 systems sit

74.4% of systems let memory change during use (T2 or T3), yet only 17 evolve their own policy. Policy evolution concentrates in systems with explicit memory records, which are easier to inspect and revise.

  • 107 hybrid T2 systems: the largest group
  • 17 of 17 self-evolving systems keep explicit records
  • 0 source/modality-specific-only or latent/parametric-only systems evolve their policy
T1 Static Memory 76 · 26% T2 Dynamic Memory 204 · 69% T3 Self-Evolving Memory 17 · 6% Total
Source- and modality-specific 23 26 – 49
Cross-represented explicit 18 49 13 80
Internalized latent & parametric 7 22 – 29
Hybrid 28 107 4 139

Each system counted once, at its highest tier. Circle area shows the value. Hover to compare with chance; click to list the systems.

T2 is growing fastest

Cumulative systems by highest tier and the year of the latest paper version. T2 Dynamic Memory dominates the recent surge; self-evolving memory appears only from 2025.

Cumulative systems by management tier, 2023–2026
0501001502002023202420252026● T2 Dynamic Memory 204● T1 Static Memory 76● T3 Self-Evolving Memory 17
Cumulative systems by management tier, 2023–2026
Series2023202420252026
T1 Static Memory5163476
T2 Dynamic Memory82877204
T3 Self-Evolving Memory00117

How T2 systems change memory

Systems using each of the paper's five operations, by modality. A system can use several. Open the breakdown below for the specific mechanisms.

T2 operations by modality
  • Update 190
  • Consolidation 105
  • Revision 55
  • Reorganization 49
  • Forgetting 47
T2 operations by modality
CategoryImageVideo & streamingAudio & speechGUI & computer useEmbodied & 3D
Update404962372
Consolidation243011634
Revision10931023
Reorganization7131424
Forgetting13113416
Mechanism breakdown

Update 190

Adds new observations or integrates them into existing records.

Consolidation 105

Merges related records or abstracts repeated experience into compact knowledge.

Revision 55

Corrects or replaces stored information that has become inconsistent or outdated.

Reorganization 49

Changes how records are grouped, linked, indexed, or moved across memory levels.

Forgetting 47

Removes records or lowers their retention or retrieval priority.

What T3 systems evolve

The 17 self-evolving systems target three kinds of policy.

Write policy 2

Feedback changes what raw experience is selected and how it is transformed into memory.

e.g. TaskMem, ABot-AgentOS

All 2 systems

Maintenance policy 1

Feedback changes which representations are retained, revised, or removed over time.

e.g. H²-EMV

All 1 systems

Retrieval policy 15

Feedback changes how queries are formed and which memories are prioritized.

e.g. RRM, ABot-AgentOS, SkeMex

All 15 systems

What each tier asks of its memory

Each step up adds a requirement, and with it a new way for memory to fail.

TierScope of persistent changeCore requirementKey bottlenecks
T1 Static MemoryNone after formationPreserve task-relevant information in a form that can be accessed and reused.Failure to preserve task-relevant information during formation; ineffective access to retained information.
T2 Dynamic MemoryMemory stateApply a controlled change to the correct target while preserving unrelated content and dependent representations.Limited editability or excessive operation scope; insufficient traces for verifiability; limited reversibility; incomplete update propagation and cross-representation inconsistency.
T3 Self-Evolving MemoryMemory state and management policyAttribute outcomes to policy decisions, revise the responsible policy, and validate the revision across subsequent use.Limited policy addressability; insufficient policy-decision traceability and feedback attribution; nonpersistent policy revisions; insufficient policy-level validation.