Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifolds
TLDR
Mind Dreamer improves model-based RL by using active causal intervention to generate non-continuous latent jumps, achieving 1.67x speedup over DreamerV3.
Reasoning
The paper introduces a novel method to address historical tethering in model-based RL with theoretical contributions like quadratic discount and spectral gap analysis. However, empirical evaluation is limited to the DeepMind Control Suite, and real-world physical experiments are absent.
Read-first score
Read-first score 51.2, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 49.
Field roles
Rank sensitivity
Stability: volatile; rank range: 427.
Keyword Scores
Deep Analysis
Innovations
- Active Causal Intervention to transcend Markovian continuity in model-based RL
- Reformulation of discovery as minimization of global Relay Expected Free Energy
- Adversarial generator for initial states creating non-continuous latent jumps to epistemic blind spots
- Relay Value Function and Relay Uncertainty Function for credit assignment across spatial ruptures
- Proof that uncertainty propagation across discontinuities necessitates quadratic discount γ^2
- Theoretical variance-minimizing importance sampler that expands manifold's spectral gap
Methodology
Mind Dreamer (MD) is a model-based reinforcement learning framework that uses an adversarial generator to sample initial states from a distribution p_gen, bypassing historical data. It derives Relay Value and Uncertainty functions to propagate pragmatic and epistemic value via Bellman-style backups, with a quadratic discount factor for uncertainty across discontinuities. The approach is evaluated on the DeepMind Control Suite against DreamerV3.
Key Results
MD achieves a 1.67× average speedup over DreamerV3 on DeepMind Control Suite, with an 8.8× speedup on sparse-reward tasks.