DIO: Decomposable Implicit 4D Occupancy-Flow World Model
TLDR
DIO is a decomposable 4D occupancy-flow world model that forecasts instance shapes from LiDAR, achieving SOTA on Argoverse 2.
Reasoning
The paper presents a novel world model with flexible instance decomposition and forecasting, achieving strong empirical results on real-world benchmarks. However, it is limited to LiDAR data and does not address interactive or generative capabilities, nor model-based RL.
Read-first score
Read-first score 53.3, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 27.
Field roles
Rank sensitivity
Stability: volatile; rank range: 402.
Keyword Scores
Deep Analysis
Innovations
- Decomposable implicit 4D occupancy-flow world model that estimates scene occupancy-flow from sparse LiDAR and decomposes it into individual instances.
- Flexible prompt representation that allows integration with off-the-shelf 3D detectors for instance prompts.
- Ability to both complete instance shapes at the present time and forecast their occupancy-flow evolution over a future horizon.
Methodology
DIO is a world model that takes sparse LiDAR observations, estimates scene occupancy-flow, and decomposes it into individual instances using an implicit representation. It employs a flexible prompt representation to incorporate instance prompts from off-the-shelf 3D detectors. The model is trained and evaluated on the Argoverse 2 dataset for 4D semantic occupancy completion and forecasting, and is also transferred to the task of LiDAR point cloud forecasting.
Key Results
DIO achieves state-of-the-art performance in 4D semantic occupancy completion and forecasting on the Argoverse 2 dataset, and ranks first in the Argoverse 4D occupancy forecasting challenge for LiDAR point cloud forecasting.