SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation
TLDR
SPW-Nav is a streaming panoramic world model that generates real-time 2K 360-degree video from language navigation instructions and a new dataset.
Reasoning
The paper introduces a novel approach with spherical rotation decoupling, pose-aligned conditioning, and multi-term memory for long-span panoramic generation, and includes a new dataset. Weaknesses include limited information about quantitative evaluation details and broader benchmark comparisons in the abstract.
Read-first score
Read-first score 37.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 52.
Field roles
Rank sensitivity
Stability: volatile; rank range: 476.
Keyword Scores
Deep Analysis
Innovations
- SPW-Nav: a streaming panoramic world model that understands movement instructions and generates one minute of 2K 360-degree video in real time from a single panorama
- Interprets each instruction in the previously generated panorama as camera motion
- Spherical rotation decoupling applies rotation exactly on the sphere
- Pose-aligned conditioning keeps translation inputs bounded over long streams
- Multi-term memory with a few-step generator continues the scene as instructions change
- SPW-NavSet dataset of panoramic videos with camera trajectories and verified instructions
- Supports on-the-fly instruction switching
Methodology
SPW-Nav takes a single panorama and language movement instructions, interpreting each instruction in the previously generated panorama as camera motion. It uses spherical rotation decoupling to apply rotation exactly on the sphere, pose-aligned conditioning to keep translation inputs bounded over long streams, and a multi-term memory with a few-step generator for continuation as instructions change. The approach is evaluated using the newly built SPW-NavSet dataset of panoramic videos with camera trajectories and verified instructions, comparing against prior panoramic generators on camera-following accuracy and video quality.
Key Results
Language-driven SPW-Nav outperforms prior panoramic generators in camera-following accuracy and video quality, and it supports on-the-fly instruction switching while generating one minute of 2K 360-degree video in real time from a single panorama.