AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control
TLDR
Introduces AD-WM, an action-discriminative joint-embedding world model for counterfactual MPC, improving planning success in simulation and real robot transfer by preserving action information.
Reasoning
The paper presents a strong methodological contribution with action-discriminative regularization and demonstrates clear empirical gains across simulation and real-world Franka transfer. Weaknesses include limited visible evidence on generative or video capabilities, and the auxiliary heads are discarded, so broader generality is not established from the abstract alone.
Read-first score
Read-first score 37.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 38.
Field roles
Rank sensitivity
Stability: volatile; rank range: 517.
Keyword Scores
Deep Analysis
Innovations
- Introduces AD-WM, an action-discriminative joint-embedding world model for counterfactual model predictive control.
- Combines residual latent dynamics with predictor-level action-recovery regularization.
- Uses inverse dynamics and a normalized recovery objective motivated by conditional mutual information to preserve action information in planning transitions.
- Auxiliary action-recovery heads are discarded at test time, leaving MPC unchanged.
Methodology
AD-WM is a latent world model with residual latent dynamics and auxiliary action-recovery heads trained using inverse dynamics and a normalized recovery objective. The auxiliary heads are removed at test time. It is evaluated on OGBench-Cube, five simulation environments against a matched LeWM/reproduced baseline, and zero-shot transfer to a Franka setup with a frozen V-JEPA 2 encoder and matched DROID post-training.
Key Results
AD-WM improves OGBench-Cube hard-start success from 3.7% to 52.0% over a matched LeWM baseline and improves mean success over the reproduced baseline in four of five simulation environments. CEM-aligned elite regret tracks closed-loop success more closely than factual prediction error or whole-bank action ranking, and zero-shot Franka basic pick-and-place success increases from 42.2% to 71.1%.
Limitations
- The reported improvement in simulation is not universal: mean success improved in four of five simulation environments.
- The zero-shot transfer result is shown only for basic pick-and-place on the Franka setup.
- The abstract does not state other explicit limitations or failure modes.