FlowMPC: Improving Flow Matching policies with World Models
TLDR
FlowMPC combines flow matching policies with a learned world model for test-time planning, improving manipulation task success.
Reasoning
The paper clearly demonstrates that adding a world model (TD-MPC2) to an imitation-learned flow matching policy improves performance in simulated manipulation tasks. Strengths include a clean integration and empirical gains; weaknesses include limited task scope and no modification of the FM training objective.
Read-first score
Read-first score 55, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 31.
Field roles
Rank sensitivity
Stability: volatile; rank range: 388.
Keyword Scores
Deep Analysis
Innovations
- Combining Flow Matching (FM) policies with a learned world model for test-time planning via Model Predictive Path Integral (MPPI)
- Introducing FlowMPC, a framework that integrates an imitation-learned FM policy with a TD-MPC2-based world model without modifying the FM training objective
- Demonstrating that world-model-based planning can effectively complement flow-based imitation policies in manipulation tasks
Methodology
FlowMPC uses a pretrained Flow Matching policy for behavior cloning and a learned world model (based on TD-MPC2) to perform MPPI planning over candidate action sequences proposed by the FM policy at test time. The approach is evaluated on ManiSkill manipulation tasks (PickCube and PickSingleYCB) against the FM policy alone, with success rate as the primary metric.
Key Results
Adding the world model improved performance over the FM policy alone on both PickCube and PickSingleYCB, with especially clear gains in end-of-episode success.
Limitations
- Evaluation is limited to only two manipulation tasks (PickCube and PickSingleYCB), so generalization to other tasks is unknown
- Requires a separately learned world model, which adds complexity and may suffer from model inaccuracies
- The approach does not modify the FM training objective, potentially limiting the extent of improvement achievable