SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer
TLDR
SANA-WM is an efficient 2.6B-parameter open-source world model for minute-scale 720p video generation with camera control, achieving high quality and efficiency.
Reasoning
The paper presents a novel architecture with hybrid linear attention and dual-branch camera control, demonstrating strong efficiency in data, training, and inference. However, it is limited to video generation and does not address interactive or RL-based world modeling, and evaluation is only on a custom benchmark.
Read-first score
Read-first score 55.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 44.
Field roles
Rank sensitivity
Stability: volatile; rank range: 323.
Keyword Scores
Deep Analysis
Innovations
- Hybrid Linear Attention combining frame-wise Gated DeltaNet (GDN) with softmax attention for memory-efficient long-context modeling
- Dual-Branch Camera Control ensuring precise 6-DoF trajectory adherence
- Two-Stage Generation Pipeline applying a long-video refiner to stage-1 outputs for improved quality and consistency
- Robust Annotation Pipeline extracting accurate metric-scale 6-DoF camera poses from public videos to yield high-quality action labels
Methodology
SANA-WM is a 2.6B-parameter hybrid linear diffusion transformer trained natively for one-minute video generation. It uses approximately 213K public video clips with metric-scale pose supervision, completes training in 15 days on 64 H100 GPUs, and is evaluated on a one-minute world-model benchmark against baselines such as LingBot-World and HY-WorldPlay. The model incorporates a distilled variant with NVFP4 quantization for deployment on a single RTX 5090.
Key Results
SANA-WM achieves visual quality comparable to large-scale industrial baselines (LingBot-World, HY-WorldPlay) while offering 36× higher throughput, and demonstrates stronger action-following accuracy than prior open-source baselines. Its distilled variant can denoise a 60-second 720p clip on a single RTX 5090 in 34 seconds.