Demo-JEPA: Joint-Embedding Predictive Architecture for One-shot Cross-Embodiment Imitation
TLDR
Demo-JEPA uses a JEPA-based world model for one-shot cross-embodiment imitation by predicting future latent trajectories from visual demonstrations.
Reasoning
The paper presents a novel framework that decouples demonstration intent from embodiment-specific actions, leveraging a world model for latent trajectory prediction. Strengths include strong empirical results on both simulated and real-world tasks, while weaknesses may include limited discussion of failure cases or scalability to more complex embodiments.
Read-first score
Read-first score 46.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 29.
Field roles
Rank sensitivity
Stability: volatile; rank range: 310.
Keyword Scores
Deep Analysis
Innovations
- Decoupling demonstration intent from embodiment-specific execution
- Using JEPA-based world model to translate source visual demonstrations into target-compatible future latent trajectories
- Avoiding action-level correspondence, requiring only visual demonstrations and target agent's own interaction experience
- One-shot cross-embodiment imitation
Methodology
Demo-JEPA is built on a JEPA-based world model. It translates source visual demonstrations into target-compatible future latent trajectories in a shared predictive representation space. The target agent then uses these latent trajectories as subgoals and realizes them through planning under its own learned forward dynamics, requiring only visual demonstrations plus the target agent's own interaction experience.
Key Results
Experiments on RLBench and real-world manipulation tasks show that Demo-JEPA matches specialized in-domain planners and generalizes to unseen tasks and embodiment configurations where prior methods fail.