GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Control
TLDR
GeoDrive integrates 3D geometry into driving world models for precise action control, improving spatial awareness and scene modeling.
Reasoning
The paper introduces a novel 3D geometry-informed driving world model with action control, showing strong results in spatial awareness and accuracy. However, the abstract lacks explicit mention of real-world datasets or benchmarks, and limitations such as occlusion handling are not fully addressed.
Read-first score
Read-first score 74, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 53.
Field roles
Rank sensitivity
Stability: volatile; rank range: 48.
Keyword Scores
Deep Analysis
Innovations
- Explicit integration of robust 3D geometry conditions into driving world models to enhance spatial understanding and action controllability
- Dynamic editing module during training that edits vehicle positions to improve renderings for dynamic modeling
- Interactive scene editing capabilities including object editing and object trajectory control
Methodology
GeoDrive first extracts a 3D representation from the input frame, then obtains a 2D rendering based on a user-specified ego-car trajectory. A dynamic editing module is introduced during training to enhance the renderings by editing the positions of vehicles, enabling dynamic modeling.
Key Results
The method significantly outperforms existing models in both action accuracy and 3D spatial awareness, and can generalize to novel trajectories while offering interactive scene editing capabilities.