Learning What to Recall: Adaptive Multi-Cue Episodic Memory for World Models
TLDR
Proposes Future-Aware Recall (FAR), a learned episodic memory retrieval approach for world models using adaptive multi-cue scoring and future-aware predictive supervision.
Reasoning
The paper addresses a meaningful gap in world models by learning which memories and cues to trust for prediction, supported by empirical evaluations across three settings. Weaknesses are that the abstract does not specify real-world deployment details or compare against a wide range of baselines.
Read-first score
Read-first score 31.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 39.
Field roles
Rank sensitivity
Stability: volatile; rank range: 268.
Keyword Scores
Deep Analysis
Innovations
- Future-Aware Recall (FAR), a framework that learns episodic recall from future-aware predictive supervision
- Adaptive multi-cue scoring that learns cue-specific relevance and automatically determines which available retrieval cues to trust per query
- Retriever trained using predictive utility measured by conditional log-likelihood of the realized future given recalled context, approximated by negative diffusion prediction loss
- Retrieval remains future-blind at inference despite future-aware training
Methodology
FAR trains an episodic memory retriever by measuring the predictive utility of recalled context through the conditional log-likelihood of the realized future, approximated by negative diffusion prediction loss. The retriever learns adaptive scoring over available retrieval cues such as time, pose, vision, and audio, but uses only current information at inference. The approach is evaluated across three complementary settings.
Key Results
FAR outperforms hand-designed recall even when using the same retrieval cues, automatically adapts which available cues to trust, and recalls the right history as the world changes.