Real Real-Time Long Video Generation Model
TLDR
Helios is a 14B autoregressive diffusion model for real-time long video generation, achieving 19.5 FPS on a single H100 without standard acceleration or anti-drifting heuristics.
Reasoning
The paper presents strong empirical results in real-time long video generation with novel training strategies for drifting and efficiency optimizations. However, it does not frame the work as a world model or address world dynamics prediction, limiting relevance to the specified keywords.
Read-first score
Read-first score 43.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 0.
Field roles
Rank sensitivity
Stability: volatile; rank range: 517.
Keyword Scores
Deep Analysis
Innovations
- Robustness to long-video drifting without commonly used anti-drifting heuristics such as self-forcing, error-banks, or keyframe sampling
- Real-time generation without standard acceleration techniques such as KV-cache, sparse/linear attention, or quantization
- Training without parallelism or sharding frameworks, enabling image-diffusion-scale batch sizes while fitting up to four 14B models within 80 GB of GPU memory
- Unified input representation that natively supports T2V, I2V, and V2V tasks
- Training strategies that explicitly simulate drifting during training and eliminate repetitive motion at its source
- Heavy compression of historical and noisy context and reduction of sampling steps for efficiency
- Infrastructure-level optimizations that accelerate both inference and training while reducing memory consumption
Methodology
Helios is a 14B autoregressive diffusion model with a unified input representation supporting text-to-video, image-to-video, and video-to-video tasks. It uses training strategies that simulate drifting during training to mitigate long-video drifting, and compresses historical and noisy context while reducing sampling steps for efficiency. Infrastructure optimizations accelerate both inference and training while reducing memory consumption.
Key Results
Helios achieves 19.5 FPS on a single NVIDIA H100 GPU for minute-scale video generation, matching the quality of a strong baseline and consistently outperforming prior methods on both short- and long-video generation.