KnowU-Bench

KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation

Tongbo Chen, Zhengxi Lu, Zhan Xu, Guocheng Shao, Shaohan Zhao, Fei Tang, et al. · 2026-04-09

Read the paper

Modality

GUI & computer use

Data

Hybrid (real + synthetic/simulated)

Task · ground truth

Act./Plan · State+Act.

Scope

Broader evaluation with memory demands

What it tests

• CECross-modal evidenceDirectly evaluated
• LELong-range evidenceDirectly evaluated
• SCState changesDirectly evaluated
• CFConflicting memoriesNot evaluated
• UQUnanswerable queriesNot evaluated
• MAMemory-grounded actionDirectly evaluated
• GSPersistent interface stateDirectly evaluated
• AOAction–outcome associationPartially evaluated
• XRCross-session reuseDirectly evaluated

Survey notes

Agents receive behavioral logs and can ask a user simulator for preferences; scoring targets personalized execution and proactive consent. The protocol does not separately evaluate retained memory or cross-session learning.