⌁ Awesome World Model Hub Papers · Datasets · Projects
中文 GitHub
← Back to papers

Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A Survey

arXiv 24.11 2024 58.6 survey

TLDR

Survey exploring integration of video generation and world models in autonomous driving, highlighting structural parallels and evaluation metrics.

Reasoning

The paper provides a comprehensive overview of the interplay between video generation and world models, identifying key works and evaluation metrics. However, as a survey, it lacks original empirical experiments or real-world benchmarks, limiting its contribution to a synthesis of existing literature.

Read-first score

Read-first score 58.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 46.

Recency 8%
75.1

Uses a gentle age decay so recent papers surface without erasing older foundations. 2024

Methodology quality 25%
70

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=evaluation,metric

Topical relevance 42%
65.7

Uses existing LLM keyword relevance scores normalized to 0-100. world model,world simulator,generative world model,interactive world model,video world model,world dynamics prediction,model-based reinforcement learning world model

Reproducibility 25%
30

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=False; dataset=False; markers=none

Field roles

Methodology anchor

Rank sensitivity

Stability: volatile; rank range: 221.

Keyword Scores

world model
10
world simulator
8
world dynamics prediction
8
generative world model
7
video world model
6
interactive world model
4
model-based reinforcement learning world model
3

Deep Analysis

Innovations

  • Investigating the interplay between video generation and world models in autonomous driving
  • Focusing on structural parallels in diffusion-based models to improve simulation coherence
  • Examining leading works (JEPA, Genie, Sora) to highlight the lack of a universally accepted definition of world models
  • Discussion of key evaluation metrics such as Chamfer distance for 3D reconstruction and Fréchet Inception Distance (FID) for video quality

Methodology

This paper is a survey that reviews and analyzes existing literature on video generation and world models for autonomous driving. It compares different approaches (JEPA, Genie, Sora) and discusses evaluation metrics, identifying critical challenges and future research directions.

Key Results

The survey identifies critical challenges and future research directions in integrating video generation and world models, emphasizing their potential to jointly advance the performance of autonomous driving systems.

Limitations

  • Lack of a universally accepted definition of world models, leading to diverse interpretations
  • The field's evolving understanding may limit the definitiveness of the findings

Resources

Paper

Tags