Multimodal Agent MemorySubmit a paper

PathNavigate

PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA

Chunze Yang, Qidong Liu, Wenjie Zhao, Yue Tang, Jiusong Ge, Di Zhang, et al. · 2026-05-22

Management
T2 Dynamic Memory
Memory changes during deployment through a stable management policy.
Primary modality
Image
Also: text
Representation
Hybrid
Distinct operative representation paths are explicitly linked for downstream retrieval, reasoning, or control.

How experience becomes memory

Each path is one memory component, traced from what is stored to how it is found again.

  1. shared slide feature memory

    1. Represented asModality-specific encodings & geometric stateSource- and modality-specific
    2. Stored inVector-indexed collection
    3. Retrieved bySimilarity search
    4. Source evidenceRetained but not accessible to the agent
    Frozen pathology features are accumulated into a slide-specific online memory used for scan and readout.Full-paper method / memory representation and retrieval · PDF p. 3 · Figure 1
  2. surprise field and abnormal-region pool

    1. Represented asSpatial, temporal & cross-modal structured memoryCross-represented explicit
    2. Stored inHierarchical multi-tier store
    3. Retrieved byMetadata / spatiotemporal retrieval
    4. Source evidenceSource linked & recoverable
    The memory produces a spatial surprise field and candidate pool before question-conditioned target selection.Full-paper method / memory representation and retrieval · PDF p. 5 · Figure 1

How memory changes (T2 operations)

  • Update · Optimization-based update

    During operation, PathNavigate applies a fixed operational optimization objective to shared slide feature memory; the memory state changes while the governing update policy remains fixed.

  • Forgetting · Progressive decay

    During operation, PathNavigate applies progressive decay of stored importance or retention to shared slide feature memory; the memory state changes while the governing update policy remains fixed.

Related systems