Awesome World Model Hub Papers · Datasets · Projects
← Back to papers

A survey on multimodal large language models for autonomous driving

WACVW 24 2024 51.3 method

TLDR

A survey on multimodal large language models for autonomous driving, covering background, tools, datasets, benchmarks, and future challenges.

Reasoning

The paper provides a systematic overview of MLLMs in autonomous driving, including datasets and benchmarks, which is a strength. However, it is a survey without novel experiments or real-world validation, limiting its empirical contribution.

Read-first score

Read-first score 51.3, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 8.

Reproducibility 25%
81

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=True; dataset=False; markers=dataset,github

Methodology quality 25%
80

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=benchmark,dataset,experiment,result

Recency 8%
75.1

Uses a gentle age decay so recent papers surface without erasing older foundations. 2024

Topical relevance 42%
11.4

Uses existing LLM keyword relevance scores normalized to 0-100. world model,world simulator,generative world model,interactive world model,video world model,world dynamics prediction,model-based reinforcement learning world model

Field roles

Methodology anchorReproducibility anchor

Rank sensitivity

Stability: volatile; rank range: 700.

Keyword Scores

world model
2
world simulator
1
generative world model
1
interactive world model
1
video world model
1
world dynamics prediction
1
model-based reinforcement learning world model
1

Deep Analysis

Innovations

  • Systematic investigation of Multimodal Large Language Models (MLLMs) for autonomous driving
  • Overview of existing MLLM tools, datasets, and benchmarks for driving, transportation, and map systems
  • Summary of the 1st WACV Workshop on Large Language and Vision Models for Autonomous Driving (LLVM-AD)
  • Discussion of key challenges and future directions for applying MLLMs in autonomous driving

Methodology

The paper conducts a systematic literature review, covering the background of Multimodal Large Language Models (MLLMs), the development of multimodal models using LLMs, the history of autonomous driving, existing MLLM tools for driving/transportation/map systems, datasets and benchmarks, and a summary of the first workshop on LLMs in autonomous driving.

Key Results

No experimental results are presented; the paper provides a comprehensive overview and identifies important problems that need to be solved by academia and industry.

Tags