DriveVA: Video Action Models are Zero-Shot Drivers
TLDR
DriveVA is an autonomous driving world model that jointly generates future videos and action trajectories, achieving strong zero-shot planning performance on NAVSIM.
Reasoning
The paper proposes a novel world model that integrates video generation and trajectory prediction, leveraging pretrained video models for stronger generalization. Strengths include the joint video-action decoding and zero-shot cross-domain results, while weaknesses include limited evidence of comparisons with prior methods and the abstract being cut off.
Read-first score
Read-first score 62.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 52.
Field roles
Rank sensitivity
Stability: volatile; rank range: 194.
Keyword Scores
Deep Analysis
Innovations
- Proposes DriveVA, an autonomous driving world model that jointly decodes future visual forecasts and action sequences in a shared latent generative process.
- Leverages rich motion dynamics and physical plausibility priors from pretrained large-scale video generation models.
- Uses a DiT-based decoder to jointly predict future action sequences/trajectories and videos for tighter alignment between planning and scene evolution.
- Introduces a video continuation strategy to strengthen long-duration rollout consistency.
Methodology
DriveVA employs a shared latent generative process with a DiT-based decoder to jointly predict future trajectories and videos, inheriting priors from pretrained large-scale video generation models. It also uses a video continuation strategy for long-duration rollout consistency. Evaluation is conducted on NAVSIM, nuScenes, and Bench2Drive/CARLA v2 against a state-of-the-art world-model-based planner.
Key Results
DriveVA achieves 90.9 PDM score on NAVSIM and reduces average L2 error and collision rate by 78.9% and 83.3% on nuScenes and 52.5% and 52.4% on Bench2Drive/CARLA v2 compared with the state-of-the-art world-model-based planner.