Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation
TLDR
Proposes Causal Forcing++ for frame-wise 1-2 step autoregressive diffusion distillation, achieving faster and better interactive video generation.
Reasoning
The paper identifies a key bottleneck in few-step AR student initialization and introduces causal consistency distillation to overcome it, showing clear improvements in latency and quality metrics. However, the abstract lacks details on real-world deployment or broader generalization, and the connection to world models is indirect.
Read-first score
Read-first score 55.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 26.
Field roles
Rank sensitivity
Stability: volatile; rank range: 489.
Keyword Scores
Deep Analysis
Innovations
- Causal consistency distillation (causal CD) for few-step AR initialization, learning AR-conditional flow map via single online teacher ODE step between adjacent timesteps, avoiding precomputation of full PF-ODE trajectories.
- Frame-wise autoregression with only 1-2 sampling steps, enabling real-time interactive video generation.
- Scalable pipeline that surpasses SOTA 4-step chunk-wise Causal Forcing under frame-wise 2-step setting with improved metrics and reduced latency/training cost.
Methodology
The paper proposes Causal Forcing++, a pipeline that uses causal consistency distillation to initialize a few-step autoregressive diffusion student. The student learns the AR-conditional flow map by receiving supervision from a single online teacher ODE step between adjacent timesteps, eliminating the need to store full PF-ODE trajectories. This initialization is then used for frame-wise autoregressive generation with only 1-2 sampling steps, and the model is evaluated on video generation benchmarks.
Key Results
Causal Forcing++ surpasses the SOTA 4-step chunk-wise Causal Forcing under the frame-wise 2-step setting by 0.1 in VBench Total, 0.3 in VBench Quality, and 0.335 in VisionReward, while reducing first-frame latency by 50% and Stage 2 training cost by approximately 4×.