ADriver-I: A General World Model for Autonomous Driving
TLDR
ADriver-I is a general world model for autonomous driving using interleaved vision-action pairs, MLLM, and diffusion to predict control signals and future frames.
Reasoning
The paper introduces a novel world model that unifies perception and control via vision-action pairs, demonstrating strong empirical results on nuScenes and private datasets. However, the abstract lacks details on limitations, baseline comparisons, and ablation studies, and the reliance on private datasets may hinder reproducibility.
Read-first score
Read-first score 73.3, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 56.
Field roles
Rank sensitivity
Stability: volatile; rank range: 82.
Keyword Scores
Deep Analysis
Innovations
- Introduction of interleaved vision-action pair to unify visual features and control signals
- Construction of a general world model combining MLLM and diffusion model for autonomous driving
- Autoregressive prediction of control signals and future frames, enabling driving in a self-created world
Methodology
ADriver-I uses interleaved vision-action pairs as input to a multimodal large language model (MLLM) and diffusion model. It autoregressively predicts the control signal for the current frame, then conditions on historical vision-action pairs and the generated control to predict future frames. This process repeats infinitely, allowing the model to drive in a world it generates itself.
Key Results
Experiments on nuScenes and a large-scale private dataset show ADriver-I achieves impressive performance compared to several constructed baselines.
Limitations
- No quantitative results or specific metrics reported in the abstract
- Evaluation relies on a private dataset, limiting reproducibility
- Comparison only to constructed baselines, not to state-of-the-art modular or end-to-end systems
- Potential error accumulation in the autoregressive loop over long horizons