CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness
TLDR
CoWorld Reasoner is an agentic framework that uses video world models as visual reasoning engines with co-evolving tools and skills, improving multimodal reasoning across benchmarks.
Reasoning
The paper presents a strong empirical evaluation across seven benchmarks and an original co-evolution method that updates tools and skills without changing model weights. However, the abstract gives little detail on limitations, implementation costs, or potential instability in the co-evolution process.
Read-first score
Read-first score 40.1, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 44.
Field roles
Rank sensitivity
Stability: volatile; rank range: 471.
Keyword Scores
Deep Analysis
Innovations
- Agentic framework using a Video World Model as a unified visual reasoning engine for flexible visual imagination
- Video World Model-Driven Harness exposing multiple visual operations as tools and using skills to guide VLM decisions on whether to imagine, operation selection, request construction, and evidence interpretation
- VLM-VWM Harness Co-Evolution jointly revising tools, skills, and execution code based on execution feedback while keeping model weights fixed
- Supports flexible visual imagination beyond fixed pipelines such as novel-view synthesis
Methodology
CoWorld Reasoner couples a VLM with a Video World Model through a harness of tools and skills, where the VLM decides whether to imagine, selects a visual operation, constructs generation requests, and interprets generated visual evidence. Tools, skills, and execution code are jointly revised via execution feedback while VLM and VWM weights remain fixed. Evaluation uses seven benchmarks spanning spatial intelligence, temporal and causal reasoning, and perceptual reasoning, with baselines including direct VLM reasoning and five evolving baselines using the same backbone.
Key Results
CoWorld Reasoner outperforms direct reasoning with the same VLM; the strongest variant improves on all seven benchmarks, with relative accuracy gains of 11.8% on MMSI and 13.0% on ERQA, and outperforms all five evolving baselines using the same backbone across five benchmarks.