SkyJEPA: Learning Long-Horizon World Models for Zero-Shot Sim-to-Real Control of Quadrotors
TLDR
SkyJEPA combines latent dynamics with physics-inspired prober for long-horizon quadrotor control, achieving zero-shot sim-to-real transfer.
Reasoning
The paper introduces a novel JEPA-style model for quadrotor control, addressing long-horizon prediction errors via latent dynamics and a physics-inspired prober. Strengths include extensive real-world experiments and zero-shot transfer; weaknesses are domain specificity to quadrotors and lack of comparison to RL-based world models.
Read-first score
Read-first score 53.8, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 32.
Field roles
Rank sensitivity
Stability: volatile; rank range: 330.
Keyword Scores
Deep Analysis
Innovations
- First application of JEPA-style model for real-time quadrotor control at high frequency
- Novel physics-inspired prober that maps frozen latent representations to interpretable physical state
- Structured pipeline for automated dataset generation to reduce reliance on real-world data
- Zero-shot sim-to-real transfer demonstrated in outdoor closed-loop experiments
Methodology
The approach combines a latent dynamics model (JEPA) with a physics-inspired prober that decodes frozen latents into interpretable state, enabling physically grounded long-horizon prediction. The learned model is integrated with a sampling-based optimal control solution for real-time control on embedded hardware, and a structured pipeline automates dataset generation to avoid expensive real-world data collection.
Key Results
Open-loop and outdoor closed-loop experiments show accurate long-horizon prediction, robust zero-shot sim-to-real transfer, and strong generalization across diverse operating conditions.