UniUGP: Unifying Understanding, Generation, and Planing For End-to-end Autonomous Driving
TLDR
UniUGP unifies understanding, generation, and planning for autonomous driving via hybrid experts and four-stage training, achieving SOTA on long-tail scenarios.
Reasoning
The paper proposes a novel framework integrating VLMs and video generation for AD, with strong empirical results on multiple datasets. However, the abstract lacks detailed evaluation metrics and may suffer from architectural complexity.
Read-first score
Read-first score 44.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 18.
Field roles
Rank sensitivity
Stability: volatile; rank range: 371.
Keyword Scores
Deep Analysis
Innovations
- Unified Understanding-Generation-Planning framework (UniUGP) that synergizes scene reasoning, future video generation, and trajectory planning through a hybrid expert architecture
- Four-stage training strategy that progressively builds capabilities across multiple existing AD datasets and newly constructed specialized datasets
- Construction of multiple specialized datasets providing reasoning and planning annotations for complex scenarios
Methodology
UniUGP integrates pre-trained vision-language models (VLMs) and video generation models into a hybrid expert architecture. It takes multi-frame observations and language instructions as input, and produces interpretable chain-of-thought reasoning, physically consistent trajectories, and coherent future videos. A four-stage training strategy is employed to progressively build these capabilities across multiple existing autonomous driving datasets and the proposed specialized datasets.
Key Results
Experiments demonstrate state-of-the-art performance in perception, reasoning, and decision-making, with superior generalization to challenging long-tail situations.