PanoWorld: Geometry-Consistent Panoramic Video World Modeling
TLDR
PanoWorld generates geometry-consistent 360° video from a single image and caption using depth and trajectory consistency losses.
Reasoning
The paper introduces a novel approach to panoramic video generation that explicitly enforces geometric consistency, supported by a new dataset and lightweight regularizers. Strengths include clear problem framing and empirical validation; weaknesses include reliance on a pre-trained model and limited scope to panoramic video.
Read-first score
Read-first score 63.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 35.
Field roles
Rank sensitivity
Stability: volatile; rank range: 515.
Keyword Scores
Deep Analysis
Innovations
- Framing panoramic video generation as a geometry- and dynamics-consistent latent state modeling problem rather than pure visual synthesis
- Depth consistency loss against pseudo ground-truth panoramic depth
- Trajectory consistency loss that supervises 3D world-frame positions of tracked points across time
- Spherical-geometry-aware adaptation to conditioning and positional encoding
- PanoGeo dataset with consistent depth, trajectory, and prompt annotations from diverse real and synthetic sources
Methodology
PanoWorld builds on a pre-trained perspective video world model and introduces two lightweight regularizers: a depth consistency loss using pseudo ground-truth panoramic depth, and a trajectory consistency loss that supervises 3D world-frame positions of tracked points over time. It further applies spherical-geometry-aware adaptation to the conditioning and positional encoding, and uses the newly introduced PanoGeo dataset for training and stratified evaluation.
Key Results
PanoWorld improves geometric consistency over prior panoramic generation methods while maintaining competitive visual realism.