StreamingBench
StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding
Junming Lin, Zheng Fang, Chi Chen, Zihao Wan, Fuwen Luo, Peng Li, et al. · 2024-11-06
- Modality
- Video & streaming
- Data
- Real data
- Task · ground truth
- QA · Ans.+Time
- Scope
- Benchmark with memory tracks
What it tests
- CECross-modal evidencePartially evaluated
- LELong-range evidenceDirectly evaluated
- SCState changesPartially evaluated
- CFConflicting memoriesNot evaluated
- UQUnanswerable queriesNot evaluated
- MAMemory-grounded actionNot evaluated
- TLTemporal localizationDirectly evaluated
- TRTemporal relationsPartially evaluated
- MEMulti-event integrationDirectly evaluated
Survey notes
Sequential Question Answering requires links to entities or events from previous question-answer turns; this is an explicit episodic-history test.