Enhance Sample Efficiency and Robustness of End-to-end Urban Autonomous Driving via Semantic Masked World Model
TLDR
Proposes SEM2, a semantic masked recurrent world model with multi-source data sampler to improve sample efficiency and robustness in end-to-end urban autonomous driving.
Reasoning
The paper introduces a novel semantic filter and data balancing technique to address task-irrelevant latent states and data imbalance, which are clear strengths. However, it only evaluates on the CARLA simulator without real-world experiments, limiting generalizability.
Read-first score
Read-first score 62.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 38.
Field roles
Rank sensitivity
Stability: volatile; rank range: 508.
Keyword Scores
Deep Analysis
Innovations
- Semantic filter to extract key driving-relevant features from latent states
- Multi-source data sampler that aggregates common data and multiple corner case data in a single batch to balance data distribution
Methodology
The paper proposes SEM2, a semantic masked recurrent world model that uses a semantic filter to extract task-relevant features from latent representations, and a multi-source data sampler to balance training data distribution by mixing common and corner case data. The model is trained end-to-end on the CARLA simulator.
Key Results
Extensive experiments on CARLA show that SEM2 outperforms state-of-the-art approaches in sample efficiency and robustness to input perturbations.