Echo-Memory: A Controlled Study of Memory in Action World Models
TLDR
A controlled study comparing memory mechanisms in action-conditioned world models, isolating capacity, compression, read-out, and recurrence axes.
Reasoning
Strengths: Clear isolation of memory design factors under a fixed backbone, with a three-branch evaluation protocol revealing that replay quality is insufficient for world memory. Weaknesses: The abstract cuts off mid-sentence, leaving some findings incomplete; no explicit mention of real-world datasets or benchmarks beyond the evaluation protocol.
Read-first score
Read-first score 62.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 45.
Field roles
Rank sensitivity
Stability: volatile; rank range: 433.
Keyword Scores
Deep Analysis
Innovations
- Controlled study isolating memory mechanisms in action world models by fixing all other components (backbone, optimizer, camera-action representation, sampler, evaluation pipeline).
- Three-branch evaluation protocol (replay quality, in-domain loop revisit, open-domain return probes) that reveals disagreement among metrics, showing replay fidelity is not a sufficient proxy for world memory.
- Key findings: raw context as a strong capacity baseline, compactness not a free substitute for capacity, and block-wise state-space recurrence as the strongest open-domain return mechanism.
Methodology
Echo-Memory fixes the action-to-video interface and varies only how history is stored and read by the generator. Under a shared video diffusion backbone, optimizer, camera-action representation, sampler, and evaluation pipeline, it compares raw context, compression-based memory, spatial summaries with different read-out paths, and state-space recurrence, separating four axes: capacity, compression, read-out, and recurrence.
Key Results
Raw context improves open-domain return far more than replay metrics; aggressive spatial and hybrid-compression memories lose salient evidence needed for return; block-wise state-space recurrence is the strongest open-domain return mechanism in the matrix.
Limitations
- Limited to a single video diffusion backbone, so generalizability to other architectures is not tested.
- Evaluation protocol may not capture all aspects of memory in real-world or diverse scenarios.
- The study does not explore all possible memory mechanisms (e.g., attention-based or learned retrieval).