ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Driving
TLDR
ImagiDrive integrates a VLM driving agent with a DWM scene imaginer for iterative planning in autonomous driving.
Reasoning
The paper proposes a novel framework combining vision-language models and driving world models for autonomous driving, addressing integration challenges. Strengths include a clear motivation and a unified loop; weaknesses are that the abstract is cut off, lacking explicit results and real-world validation.
Read-first score
Read-first score 70.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 43.
Field roles
Rank sensitivity
Stability: volatile; rank range: 175.
Keyword Scores
Deep Analysis
Innovations
- Unified imagination-and-planning loop integrating a VLM-based driving agent with a DWM-based scene imaginer
- Early stopping mechanism to improve computational efficiency
- Trajectory selection strategy to enhance predictive accuracy
Methodology
ImagiDrive is an end-to-end autonomous driving framework that combines a VLM-based driving agent with a DWM-based scene imaginer. The agent first predicts initial driving trajectories from multi-modal inputs, then the imaginer generates corresponding future scenarios, which are iteratively used to refine the agent's planning decisions. An early stopping mechanism and a trajectory selection strategy are introduced to address efficiency and accuracy challenges. The model is evaluated on the nuScenes and NAVSIM datasets under both open-loop and closed-loop conditions.
Key Results
Extensive experiments on nuScenes and NAVSIM demonstrate that ImagiDrive achieves robustness and superiority over previous alternatives in both open-loop and closed-loop driving scenarios.