AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
TLDR
AlayaWorld is an interactive long-horizon video world model using a 15B diffusion transformer and autoregressive distillation for efficient 24fps generation.
Reasoning
The paper presents a strong architecture combining bounded visual context and distillation for long-horizon consistency, but the abstract lacks detailed comparison to existing methods and explicit real-world validation beyond a single benchmark.
Read-first score
Read-first score 41.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 56.
Field roles
Rank sensitivity
Stability: volatile; rank range: 417.
Keyword Scores
Deep Analysis
Innovations
- Interactive long-horizon video world model generating 24-fps at 540p/720p
- Autoregressive generation of short latent chunks under camera trajectories and switchable text prompts
- Bounded visual context: persistent sink frame, compressed temporal history, geometry-aligned spatial memory, recent-frame conditioning
- Training with corrupted histories and prediction residuals from model's own roll-outs to reduce long-term drift
- Discrete autoregressive distillation combining distribution-matching distillation, self-forcing++, and consistency distillation to reduce inference from ~30 steps to 4 steps per chunk
Methodology
AlayaWorld is a 15B video diffusion transformer that generates short latent chunks autoregressively, conditioned on camera trajectories, switchable text prompts, and a bounded visual context comprising a persistent sink frame, compressed temporal history, geometry-aligned spatial memory, and recent frames. To mitigate drift, it is trained with corrupted histories and prediction residuals from its own roll-outs. A discrete autoregressive distillation formulation reduces inference steps while maintaining quality.
Key Results
On iWorld-Bench, AlayaWorld achieves the best performance over long-horizon generation.