AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control
TLDR
Introduces AD-WM, an action-discriminative joint-embedding world model for counterfactual MPC, improving planning success in simulation and real robot transfer by preserving action information.
评分理由
The paper presents a strong methodological contribution with action-discriminative regularization and demonstrates clear empirical gains across simulation and real-world Franka transfer. Weaknesses include limited visible evidence on generative or video capabilities, and the auxiliary heads are discarded, so broader generality is not established from the abstract alone.
Read-first 评分解释
综合优先阅读分 37.4,由主题、引用、图谱、方法、可复现性和近期性等信号加权得到。 原始总分保留为 38。
研究版图角色
排序敏感性
稳定性:volatile;排名波动范围:517。
关键词评分
深度分析
创新点
- Introduces AD-WM, an action-discriminative joint-embedding world model for counterfactual model predictive control.
- Combines residual latent dynamics with predictor-level action-recovery regularization.
- Uses inverse dynamics and a normalized recovery objective motivated by conditional mutual information to preserve action information in planning transitions.
- Auxiliary action-recovery heads are discarded at test time, leaving MPC unchanged.
方法
AD-WM is a latent world model with residual latent dynamics and auxiliary action-recovery heads trained using inverse dynamics and a normalized recovery objective. The auxiliary heads are removed at test time. It is evaluated on OGBench-Cube, five simulation environments against a matched LeWM/reproduced baseline, and zero-shot transfer to a Franka setup with a frozen V-JEPA 2 encoder and matched DROID post-training.
关键结果
AD-WM improves OGBench-Cube hard-start success from 3.7% to 52.0% over a matched LeWM baseline and improves mean success over the reproduced baseline in four of five simulation environments. CEM-aligned elite regret tracks closed-loop success more closely than factual prediction error or whole-bank action ranking, and zero-shot Franka basic pick-and-place success increases from 42.2% to 71.1%.
局限性
- The reported improvement in simulation is not universal: mean success improved in four of five simulation environments.
- The zero-shot transfer result is shown only for basic pick-and-place on the Franka setup.
- The abstract does not state other explicit limitations or failure modes.