A Recipe for Efficient Sim-to-Real Transfer in Manipulation with Online Imitation-Pretrained World Models
TLDR
A sim-to-real framework using world models for online imitation pretraining and offline finetuning improves manipulation transfer with limited real-world data.
Reasoning
The paper clearly addresses a practical problem (limited real-world data) and proposes a novel combination of online imitation pretraining with world models, showing significant empirical gains in both sim-to-sim and sim-to-real transfers. However, the abstract lacks details on the world model architecture and the specific real-world experimental setup, limiting full assessment of methodology.
Read-first score
Read-first score 46.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 28.
Field roles
Rank sensitivity
Stability: volatile; rank range: 375.
Keyword Scores
Deep Analysis
Innovations
- Combining online imitation pretraining with offline finetuning in a world model framework for sim-to-real transfer
- Using online interactions to alleviate data coverage limitations of offline imitation learning methods
- Achieving significant improvement in success rates (≥31.7% sim-to-sim, ≥23.3% sim-to-real) over offline baselines
Methodology
The proposed sim-to-real framework is based on world models and combines online imitation pretraining using a robot simulator with offline finetuning on limited real-world expert data. Online interactions during pretraining improve data coverage and robustness, reducing performance degradation during finetuning and enhancing domain transfer.
Key Results
The method improves success rates by at least 31.7% in sim-to-sim transfer and 23.3% in sim-to-real transfer compared to existing offline imitation learning baselines.