StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation
TLDR
StatePlay jointly predicts visual content and game states via a mixture-of-transformers architecture to ensure mechanics-consistent game world generation.
Reasoning
The paper addresses a clear gap in game world models by explicitly modeling state-dependent game mechanics, with strong quantitative results (state prediction L1 < 0.06, 18.6% improvement in mechanics fidelity). However, the evaluation is limited to game domains, and the claim of 'complete' generation is not fully supported by the abstract alone.
Read-first score
Read-first score 40.2, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 48.
Field roles
Rank sensitivity
Stability: volatile; rank range: 312.
Keyword Scores
Deep Analysis
Innovations
- State-aware game world model that jointly predicts visual frames and game states for mechanics-consistent generation.
- Mixture-of-transformers (MoT) architecture with specialized visual and state branches, cross-modal interaction, and modality-specific optimization objectives.
- Explicit state prediction to enforce game mechanics, going beyond pixel-level realism.
Methodology
StatePlay is a mixture-of-transformers model that jointly predicts visual content and game states conditioned on player actions. It preserves specialized visual and state representations with cross-modal interaction, allowing predicted states to guide frame generation, and each branch is optimized with a distinct objective suitable for its modality.
Key Results
StatePlay achieves an average normalized L1 distance below 0.06 for state prediction and improves mechanics fidelity by 18.6% over models without explicit state modeling.