Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers
TLDR
WorldWeaver: a streaming multi-agent video diffusion model with world state registers for cross-agent consistency.
Reasoning
The paper introduces world state registers to maintain shared world information across agents, addressing a key limitation in multi-agent video generation. Its strengths include the novel architectural design and explicit state supervision, but weaknesses are the limited evaluation to two-agent Minecraft and lack of comparison to interactive or RL-based world models.
Read-first score
Read-first score 39.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 47.
Field roles
Rank sensitivity
Stability: volatile; rank range: 292.
Keyword Scores
Deep Analysis
Innovations
- Cross-agent world state registers: learnable tokens that store shared world information, track individual agent status, and are dynamically updated after each generated chunk.
- Streaming multi-agent autoregressive video diffusion model (WorldWeaver) that incorporates world state registers into the rollout.
- Supervision signals for world state registers including individual agent status, global state views (bird's-eye views), and scene text.
- Mixture-of-Transformers architecture with separate weights for world state modeling and visual frame modeling.
Methodology
The paper presents WorldWeaver, a streaming multi-agent video diffusion model that augments autoregressive chunk generation with learnable cross-agent world state registers. These registers are updated dynamically and supervised with agent status, bird's-eye views, and scene text. A Mixture-of-Transformers design separates world state and visual frame processing. The model is evaluated on two-agent Minecraft video generation.
Key Results
Explicit world-state modeling via registers improves logical consistency and generation quality in two-agent Minecraft video generation.