SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation
TLDR
SPW-Nav is a streaming panoramic world model that generates real-time 2K 360-degree video from language navigation instructions and a new dataset.
评分理由
The paper introduces a novel approach with spherical rotation decoupling, pose-aligned conditioning, and multi-term memory for long-span panoramic generation, and includes a new dataset. Weaknesses include limited information about quantitative evaluation details and broader benchmark comparisons in the abstract.
Read-first 评分解释
综合优先阅读分 37.6,由主题、引用、图谱、方法、可复现性和近期性等信号加权得到。 原始总分保留为 52。
研究版图角色
排序敏感性
稳定性:volatile;排名波动范围:476。
关键词评分
深度分析
创新点
- SPW-Nav: a streaming panoramic world model that understands movement instructions and generates one minute of 2K 360-degree video in real time from a single panorama
- Interprets each instruction in the previously generated panorama as camera motion
- Spherical rotation decoupling applies rotation exactly on the sphere
- Pose-aligned conditioning keeps translation inputs bounded over long streams
- Multi-term memory with a few-step generator continues the scene as instructions change
- SPW-NavSet dataset of panoramic videos with camera trajectories and verified instructions
- Supports on-the-fly instruction switching
方法
SPW-Nav takes a single panorama and language movement instructions, interpreting each instruction in the previously generated panorama as camera motion. It uses spherical rotation decoupling to apply rotation exactly on the sphere, pose-aligned conditioning to keep translation inputs bounded over long streams, and a multi-term memory with a few-step generator for continuation as instructions change. The approach is evaluated using the newly built SPW-NavSet dataset of panoramic videos with camera trajectories and verified instructions, comparing against prior panoramic generators on camera-following accuracy and video quality.
关键结果
Language-driven SPW-Nav outperforms prior panoramic generators in camera-following accuracy and video quality, and it supports on-the-fly instruction switching while generating one minute of 2K 360-degree video in real time from a single panorama.