Long-term Traffic Simulation via Structured Autoregressive Modeling
TLDR
RosettaSim uses frozen LLMs for structured autoregressive traffic simulation, achieving state-of-the-art short- and long-term accuracy on Waymo.
Reasoning
The paper introduces a novel framework (RosettaSim) that leverages LLMs for traffic simulation, supported by probing experiments and a new evaluation method (RTE). Strengths include strong empirical results on a real-world benchmark and addressing dynamic token cardinality. Weaknesses include limited scope to traffic domain and reliance on frozen LLMs without exploring full fine-tuning.
Read-first score
Read-first score 41.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 43.
Field roles
Rank sensitivity
Stability: volatile; rank range: 281.
Keyword Scores
Deep Analysis
Innovations
- Leveraging synergy between architectural inductive biases and statistical priors of LLMs for traffic simulation
- Probing experiments showing transferability of attention mechanisms and distributional consistency between motion tokens and natural language, enabling small-scale frozen LLMs to adapt
- RosettaSim: unified framework projecting scene topology, agent states, and spawning intents into a structured autoregressive stream with variable length
- Retrieval-based Traffic Evaluation (RTE) that retrieves semantically similar real-world scenarios as context-aware reference anchors for long-horizon evaluation
Methodology
The paper proposes RosettaSim, a framework that adapts small-scale, heavily frozen LLMs by projecting scene topology, agent states, and spawning intents into a structured autoregressive stream with variable length. It also introduces RTE, which retrieves semantically similar real-world scenarios as reference anchors for evaluating extended rollouts. Experiments are conducted on the Waymo Open Sim Agent Challenge (WOSAC).
Key Results
RosettaSim achieves state-of-the-art performance in both short- and long-term simulation on WOSAC. RTE shows stronger correlation with standard metrics (r=0.83) than existing approaches (r=0.74).