LongDWM: Cross-Granularity Distillation for Building a Long-Term Driving World Model
TLDR
A long-term driving world model using hierarchical decoupling and cross-granularity distillation to reduce error accumulation and improve video coherence.
Reasoning
The paper addresses a clear limitation (error accumulation in long-term video prediction) with a novel hierarchical distillation approach, achieving significant improvements on NuScenes. Strengths include strong empirical results and efficiency gains; weaknesses are limited to front-view only and lack of interactive or RL context.
Read-first score
Read-first score 69.1, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 48.
Field roles
Rank sensitivity
Stability: volatile; rank range: 78.
Keyword Scores
Deep Analysis
Innovations
- Hierarchical decoupling of world model learning into large motion learning and bidirectional continuous motion learning
- Distillation method where fine-grained video flows serve as self-supervised signals for coarse-grained flows
- Coordination of coarse-grained and fine-grained modules to generate long-term temporally coherent videos
Methodology
The model hierarchically decouples world model learning into large motion learning and bidirectional continuous motion learning. It proposes a distillation method where fine-grained video flows act as self-supervised signals for coarse-grained flows, and the coarse-grained and fine-grained modules are coordinated to generate long-term and temporally coherent videos.
Key Results
On the NuScenes benchmark, compared with the state-of-the-art front-view model, the proposed model improves FVD by 27% and reduces inference time by 85% for generating 110+ frames.
Limitations
- Current models suffer serious error accumulations when predicting the long-term future
- Training on short video clips (high fps and short duration) leads to a training-inference gap
- Multiple roll-out generations struggle to produce consistent and reasonable long videos