DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory
TLDR
Proposes DecMem, a decoupled memory architecture for minute-long consistent video generation with fine-grained spatio-temporal consistency.
Reasoning
The paper introduces a novel decoupled memory approach to address long-horizon consistency in video generation, which is a strength. However, the abstract lacks specific quantitative results or dataset details, and the focus is narrow (video generation) without addressing interactive or RL settings.
Read-first score
Read-first score 53.2, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 37.
Field roles
Rank sensitivity
Stability: volatile; rank range: 378.
Keyword Scores
Deep Analysis
Innovations
- Decoupled memory architecture with Sparse Global Memory for efficient fine-grained access to global history and Anchored Local Memory for stable and high-quality extrapolation
- Identification and systematic analysis of attention dispersion as a fundamental limitation of naïve learnable memory architectures in long-horizon extrapolation
- Fine-grained, learnable, and scalable memory for consistent world generation, moving beyond explicit 3D memory and coarse frame-level implicit modeling
Methodology
The paper proposes DecMem, a decoupled memory architecture that employs Sparse Global Memory for efficient fine-grained access to global history and Anchored Local Memory for stable and high-quality extrapolation. It addresses two fundamental limitations of naïve learnable memory: computational inefficiency and attention dispersion. The model is evaluated on long video generation tasks, comparing to state-of-the-art methods.
Key Results
DecMem significantly outperforms current state-of-the-art methods, enabling minute-level controllable long video generation with high fidelity and consistency.