GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Prediction
TLDR
Proposes GaussianWorld, a world model framework for streaming 3D occupancy prediction that exploits scene evolution, improving performance on nuScenes.
Reasoning
Strengths include a novel decomposition of scene evolution into three factors and explicit use of a world model to improve prediction without extra computation. Weaknesses are limited evaluation to a single dataset and lack of comparison to other world model approaches.
Read-first score
Read-first score 54.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 19.
Field roles
Rank sensitivity
Stability: volatile; rank range: 578.
Keyword Scores
Deep Analysis
Innovations
- Reformulating 3D occupancy prediction as a 4D occupancy forecasting problem conditioned on current sensor input
- Decomposing scene evolution into three explicit factors: ego motion alignment of static scenes, local movements of dynamic objects, and completion of newly-observed scenes
- Employing a Gaussian world model (GaussianWorld) to explicitly exploit scene evolution priors in 3D Gaussian space
- Achieving performance improvement over single-frame counterpart without introducing additional computations
Methodology
The method reformulates 3D occupancy prediction as a 4D occupancy forecasting problem conditioned on current sensor input, decomposing scene evolution into three factors: ego motion alignment, dynamic object movements, and new scene completion. It uses a Gaussian world model to infer scene evolution in 3D Gaussian space from the current RGB observation. The model is evaluated on the nuScenes dataset, comparing against a single-frame baseline using mean Intersection over Union (mIoU).
Key Results
GaussianWorld improves the performance of the single-frame counterpart by over 2% in mIoU without introducing additional computations.