Imagined Rollouts are Kinematic, Not Dynamic: A Diagnosis of Long-Horizon World-Model Failure
TLDR
World models fail long-horizon due to kinematic (not dynamic) errors; a diagnostic (iKCE) reveals this in DreamerV3 on DMC walker-walk.
Reasoning
Strengths: Novel kinematic-vs-dynamic reframing with a clear diagnostic (iKCE) and empirical validation on a released checkpoint. Weaknesses: Limited to a single environment and checkpoint; no real-world or diverse-domain experiments.
Read-first score
Read-first score 38.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 45.
Field roles
Rank sensitivity
Stability: volatile; rank range: 259.
Keyword Scores
Deep Analysis
Innovations
- Proposes a kinematic-vs-dynamic reframing of long-horizon world-model failure, distinguishing the type of compounding error.
- Introduces the imagined Kinematic-Consistency Error (iKCE), a per-step diagnostic measuring departure from a closed-form kinematic null.
- Develops a perturbation protocol that tests whether iKCE responds when physical conditions cross a regime boundary.
Methodology
The method computes imagined rollouts from a released DreamerV3 checkpoint on the DMC walker-walk task, calculates iKCE as the deviation from a closed-form kinematic model, and compares it to real-physics rollouts. A friction sweep is used to cross the gait-collapse boundary, and the response of iKCE versus reward is analyzed.
Key Results
Imagined iKCE is about two orders of magnitude higher than in real-physics rollouts; across a friction sweep, iKCE remains statistically flat even as the policy's reward collapses, indicating the model imagines kinematically rather than dynamically.