Dream-MPC: Gradient-Based Model Predictive Control with Latent Imagination
TLDR
Dream-MPC combines gradient-based MPC with a learned world model and policy prior, outperforming gradient-free methods on 24 continuous control tasks.
Reasoning
The paper presents a novel gradient-based MPC approach that leverages a learned world model for trajectory optimization, showing strong empirical results across many tasks. However, it lacks real-world validation and does not address video or interactive world models explicitly.
Read-first score
Read-first score 55.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 43.
Field roles
Rank sensitivity
Stability: volatile; rank range: 289.
Keyword Scores
Deep Analysis
Innovations
- Gradient-based Model Predictive Control with latent imagination using a learned world model
- Uncertainty regularization for trajectory optimization
- Amortization of optimization iterations over time by reusing previously optimized actions
Methodology
Dream-MPC generates a small number of candidate trajectories by rolling out a policy, then optimizes each trajectory via gradient ascent using a learned world model. It incorporates uncertainty regularization and amortizes optimization iterations across time steps by reusing previously optimized actions.
Key Results
On 24 continuous control tasks, Dream-MPC significantly improves the performance of the underlying policy and outperforms gradient-free MPC as well as state-of-the-art baselines.