Multimodal Agent MemorySubmit a paper

SkillGraph

SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topology

Zheng Nie, Ruolin Shen, Xinlei Yu, Bo Yin, Jiangning Zhang, Xiaobin Hu · 2026-04-19

Read the paperPDF

Management
T1 Static Memory
Memory is built once and reused without change during deployment.
Primary modality
Image
Also: text
Representation
Cross-represented explicit

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. multimodal Skill Bank

    1. Represented asPerception-to-text records & summariesCross-represented explicit
    2. Stored inModular adapter bank
    3. Retrieved bySimilarity search
    4. Source evidenceSource not retained
    Failure cases are distilled into a persistent multimodal bank of reusable reasoning heuristics.Full-paper method / memory representation and retrieval · PDF p. 3 · Figure 1

  2. collaboration topology state

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inGraph / relational store
    3. Retrieved byStructure traversal
    4. Source evidenceSource not retained
    Skill embeddings condition a graph transformer that predicts query-specific agent communication topology.Full paper: Method · PDF p. 4 · Figure 1

Related systems