Programmable World Model
TLDR
Programmable World Model decouples persistent state from video generation using executable programs and 3D OBBs, enabling controllable game worlds and outperforming existing interactive video models.
Reasoning
The paper introduces a clear framework for persistent, programmatically controllable world state in video generation, with a new benchmark and strong quantitative results. However, the abstract provides limited details on generalization, scalability, and comparison protocols, and the benchmark may be narrow.
Read-first score
Read-first score 39.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 52.
Field roles
Rank sensitivity
Stability: volatile; rank range: 498.
Keyword Scores
Deep Analysis
Innovations
- Programmable World Model framework that decouples world-state evolution from visual observation generation
- Natural-language instructions translated into executable programs specifying entity states and state-transition rules
- Lightweight engine that maintains an explicit, persistent global world state, including off-screen entities and non-visual attributes
- State-augmented 3D oriented bounding boxes as an intermediate representation, deterministically compiled into pixel-aligned spatiotemporal conditioning signals for a pretrained video model
- CombatStateBench benchmark for evaluating programmable world models
Methodology
The framework decouples state evolution from visual generation: an agent translates natural-language instructions into executable programs, and a lightweight engine executes those programs to maintain an explicit, persistent global world state. State-augmented 3D oriented bounding boxes and target camera trajectories are deterministically compiled into pixel-aligned spatiotemporal conditioning signals for a pretrained video model used as a generative renderer. Evaluation uses the introduced CombatStateBench and reports Count Accuracy and State Accuracy against existing interactive video world models.
Key Results
On CombatStateBench, the method achieves 94% Count Accuracy and 98% State Accuracy, substantially outperforming existing interactive video world models while supporting coherent long-horizon generation.