Alaya-EVOKE: From Linear-Scaling Supervision to Endless World
TLDR
Evoke presents an interactive world model with externalized state and linear-scaling supervision, enabling long-horizon generation and responsive few-step student inference.
Reasoning
The paper introduces a novel architecture that decouples persistent world state from the denoiser context and uses a redesigned teacher for long-horizon supervision, addressing key scalability and interaction trade-offs. However, the abstract lacks explicit real-world benchmarks or datasets, making empirical validation unclear from the visible text.
Read-first score
Read-first score 38.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 49.
Field roles
Rank sensitivity
Stability: volatile; rank range: 315.
Keyword Scores
Deep Analysis
Innovations
- Externalizing persistent world state in a camera-indexed world state bank, retrieving only view-relevant information to keep denoiser context bounded as session length grows.
- Redesigning the teacher for long-horizon supervision using sparse attention with chunk-wise grouping, retrieval of selected distant frames, and a linear-attention global state, achieving linear memory/compute scaling and exposing content drift.
- Per-chunk conditioning in the teacher to enable prompt changes and event control throughout the sequence.
- A 30-second distribution-matching objective under self-forced rollouts to transfer long-horizon capabilities to a three-step student that requires no classifier-free guidance.
Methodology
Evoke separates persistent world state into an external, camera-indexed bank from which only view-relevant information is retrieved, keeping the denoiser context bounded. The teacher model uses sparse attention combining chunk-wise grouping, distant-frame retrieval, and a linear-attention global state to provide long-horizon supervision with linear cost. A distribution-matching objective with self-forced rollouts transfers these capabilities to a three-step student model that operates without classifier-free guidance.
Key Results
Evoke achieves state-of-the-art performance on WBench and remains competitive on VBench-Long and VBench-2.0. On a single H200 at 384×640 resolution, each 1.5 s chunk is generated in 2.11 s, supporting open-ended continuous generation.