Latent Chain-of-Thought World Modeling for End-to-End Driving
TLDR
Latent-CoT-Drive uses latent chain-of-thought with world model tokens for end-to-end driving, achieving faster inference and better trajectory quality.
Reasoning
The paper introduces a novel latent reasoning space that unifies action proposals and world model tokens, supported by cold-start supervision and closed-loop RL post-training. Strengths include improved inference speed and trajectory quality over text-based reasoning baselines, but the approach is domain-specific and lacks discussion of generalization or safety limitations.
Read-first score
Read-first score 43.5, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 41.
Field roles
Rank sensitivity
Stability: volatile; rank range: 420.
Keyword Scores
Deep Analysis
Innovations
- Introduces latent chain-of-thought (CoT) reasoning using action-proposal tokens and world model tokens instead of natural language
- Unifies CoT reasoning and decision making in an action-aligned latent space
- Cold starts latent CoT by supervising action proposals and world model tokens with ground-truth future rollouts
- Post-trains with closed-loop reinforcement learning to strengthen reasoning capabilities
Methodology
LCDrive models reasoning as interleaved sequences of action-proposal tokens (from the same vocabulary as output actions) and world model tokens (grounded in a learned latent world model that predicts future outcomes). The model is first cold-started via supervised learning on ground-truth future rollouts, then fine-tuned with closed-loop reinforcement learning. Evaluation is performed on a large-scale end-to-end driving benchmark against non-reasoning and text-reasoning baselines.
Key Results
LCDrive achieves faster inference, better trajectory quality, and larger improvements from interactive reinforcement learning compared to both non-reasoning and text-reasoning baselines.
Limitations
- Requires ground-truth future rollouts for cold-start supervision, which may be expensive or unavailable in real-world settings
- Latent representations may be less interpretable than natural language, making debugging or safety analysis more challenging