SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation
TLDR
SparseWorld is a lightweight world model using sparse scene representation to predict future driving scenarios, improving end-to-end autonomous driving planning and reducing collision risk.
Reasoning
The paper introduces a novel sparse representation for world models, reducing computational cost while achieving state-of-the-art results on nuScenes and Bench2Drive benchmarks. However, the evaluation is limited to open-loop metrics on nuScenes and closed-loop on Bench2Drive, and potential limitations or failure cases are not discussed.
Read-first score
Read-first score 61.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 46.
Field roles
Rank sensitivity
Stability: volatile; rank range: 419.
Keyword Scores
Deep Analysis
Innovations
- Sparse scene representation for world models to reduce computational cost and redundant information
- Autoregressive rollout to forecast future map elements and surrounding agents
- Sparse Dreamer with joint temporal and spatial attention for predicting future instances in latent space
- Leveraging predicted futures to refine motion prediction and trajectory planning
Methodology
SparseWorld is a lightweight world model that first performs autoregressive rollout to forecast future map elements and surrounding agents, enabling the model to learn how driving scenarios evolve over time. It then uses these predicted futures to refine downstream motion prediction and trajectory planning via a Sparse Dreamer that anticipates future instances in latent space through joint temporal and spatial attention. The motion planner interacts with predicted future instances to capture more accurate motion patterns and generate safety-aware trajectories.
Key Results
SparseWorld achieves state-of-the-art performance on open-loop planning metrics of the nuScenes dataset with a collision rate of 0.05%, and substantially outperforms the baseline method in closed-loop planning metrics on the Bench2Drive benchmark.