Self-Supervised JEPA-based World Models for LiDAR Occupancy Completion and Forecasting
TLDR
Self-supervised JEPA-based world model for LiDAR occupancy completion and forecasting in autonomous driving.
Reasoning
The paper proposes a novel self-supervised world model using JEPA for spatiotemporal prediction from LiDAR data, with promising proof-of-concept results on occupancy completion and forecasting. However, the evaluation is limited to a single downstream task and lacks comparison to strong baselines or real-world deployment details.
Read-first score
Read-first score 53.2, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 30.
Field roles
Rank sensitivity
Stability: volatile; rank range: 466.
Keyword Scores
Deep Analysis
Innovations
- Self-supervised JEPA-based world model for autonomous driving using LiDAR data
- Joint-embedding predictive architecture (JEPA) applied to spatiotemporal evolution prediction from LiDAR
- Downstream LiDAR occupancy completion and forecasting (OCF) task to evaluate learned representations
Methodology
The paper proposes AD-LiST-JEPA, a self-supervised world model that uses a joint-embedding predictive architecture (JEPA) to predict future spatiotemporal evolution from LiDAR data. The learned representations are evaluated through a downstream LiDAR-based occupancy completion and forecasting (OCF) task, which jointly assesses perception and prediction.
Key Results
Proof of concept experiments show better OCF performance with the pretrained encoder after JEPA-based world model learning compared to baselines.
Limitations
- Proof of concept experiments only, limited scale and generalizability not yet validated