Scaling World Model for Hierarchical Manipulation Policies
TLDR
Hierarchical VLA framework using a world model as high-level planner to generate goal images, boosting OOD manipulation performance from 14% to 69%.
Reasoning
The paper presents a novel hierarchical approach that leverages a pre-trained world model for subgoal decomposition, showing strong empirical gains in out-of-distribution scenarios. However, the abstract lacks details on the world model architecture and the scope of real-world validation, limiting assessment of generalizability.
Read-first score
Read-first score 49.5, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 28.
Field roles
Rank sensitivity
Stability: volatile; rank range: 476.
Keyword Scores
Deep Analysis
Innovations
- Hierarchical Vision-Language-Action framework combining a world model as high-level planner and a VLA as low-level executor
- Use of a large-scale pre-trained world model to synthesize goal images for visual subgoal task decomposition (VISTA)
- Significant improvement in out-of-distribution generalization by providing visually and physically grounded goal images to low-level policies
Methodology
The proposed hierarchical framework VISTA consists of a world model as the high-level planner that divides manipulation tasks into subtask sequences with goal images, and a VLA model as the low-level executor that follows textual and visual guidance to generate action sequences. The world model is pre-trained at scale, and the system is validated in massive out-of-distribution scenarios using the same-structured VLA with and without world model guidance.
Key Results
The performance of the same-structured VLA in novel scenarios improved from 14% to 69% when guided by the world model, and the method outperformed previous baselines with a clear margin, particularly in out-of-distribution scenarios.