Awesome World Model Hub Papers · Datasets · Projects
← Back to papers

Solving Motion Planning Tasks with a Scalable Generative Model

ECCV 24 2024 74.6 method, application

TLDR

A scalable generative model for autonomous driving that learns scene dynamics, enabling simulation, scenario generation, and planning, achieving SOTA on real-world benchmarks.

Reasoning

Strengths include novel autoregressive modes for efficiency, strong empirical results on two real-world datasets, and open-source code. Weaknesses are limited to driving domain and lack of discussion on generalization or long-horizon simulation limitations.

Read-first score

Read-first score 74.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 54.

Reproducibility 25%
85

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=True; dataset=False; markers=code,dataset,github

Topical relevance 42%
77.1

Uses existing LLM keyword relevance scores normalized to 0-100. world model,world simulator,generative world model,interactive world model,video world model,world dynamics prediction,model-based reinforcement learning world model

Recency 8%
75.1

Uses a gentle age decay so recent papers surface without erasing older foundations. 2024

Methodology quality 25%
60

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=benchmark,dataset

Field roles

Reproducibility anchor

Rank sensitivity

Stability: volatile; rank range: 75.

Keyword Scores

world model
9
world simulator
9
generative world model
9
world dynamics prediction
8
interactive world model
7
model-based reinforcement learning world model
7
video world model
5

Deep Analysis

Innovations

  • Scalable generative model that learns dynamics of driving scenes for motion planning
  • Dual-mode autoregressive design (full-autoregressive and partial-autoregressive) improving inference and training speed without sacrificing generative capability
  • Ability to simulate diverse futures and generate driving scenarios conditioned on various prompts
  • Unified model serving as online reactive environment for reinforcement learning, evaluator for planning policies, and high-fidelity simulator

Methodology

The paper proposes a generative model that learns the dynamics of driving scenes. It operates in both full-autoregressive and partial-autoregressive modes to enhance training and inference efficiency. The model is evaluated on the Waymo motion dataset and nuPlan dataset for simulation realism, scene generation, and planning benchmarks.

Key Results

The model achieves state-of-the-art performance on simulation realism and scene generation benchmarks, and the planner outperforms prior arts on planning benchmarks.

Tags