Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generation
TLDR
Proposes Heterogeneous Step Allocation (HSA), a training-free inference algorithm that assigns variable denoising steps to video DiT tokens for efficient video generation.
Reasoning
Strengths include a practical training-free approach with clear mechanisms (KV-cache synchronization and cached Euler updates) and strong empirical gains on multiple video generation models. Weaknesses visible from the abstract include limited detail on limitations, evaluation metrics, and comparison to broader world-model methods.
Read-first score
Read-first score 20.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 5.
Field roles
Frontier
Rank sensitivity
Stability: volatile; rank range: 125.