AVL-JEPA: Preventing Causal Dynamics Information Collapse In Joint Embedding Predictive Architecture World Models
TLDR
AVL-JEPA prevents causal dynamics information collapse in JEPA world models by adding action and vision invariance pathways, improving control under perturbations.
Reasoning
The paper identifies a clear failure mode and proposes a method with supporting ablations on four control tasks. However, the abstract lacks baseline details and statistical rigor, and the tasks may be simulated rather than physically real-world.
Read-first score
Read-first score 31.5, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 34.
Field roles
Rank sensitivity
Stability: volatile; rank range: 232.
Keyword Scores
Deep Analysis
Innovations
- Identifies causal dynamics information collapse as a failure mode in joint embedding predictive architectures, where visual information is preserved but action-relevant physical consequence information is discarded.
- Proposes action-grounded vision-invariance latent (AVL) to prevent causal dynamics information collapse.
- Uses executed actions as auxiliary dynamics anchors to encourage preservation of dynamics information.
- Introduces a vision-invariance pathway that aligns perturbed and clean latent predictions without discarding dynamics information.
- Evaluates preservation of causal dynamics through physical consequence alignment, clean-noisy dynamics consistency, and targeted transition subspace erasure.
Methodology
AVL extends joint embedding predictive architecture world models with an action-grounded auxiliary dynamics anchor and a vision-invariance pathway that aligns perturbed and clean latent predictions. The method is evaluated on four robotic control tasks: TwoRoom, PushT, OGBench Cube, and Reacher. Evaluation includes success rates under visual perturbations, clean-environment performance, physical consequence alignment, clean-noisy dynamics consistency, and causal effect of targeted transition subspace erasure.
Key Results
AVL substantially improves success rates under visual perturbations while preserving clean-environment performance on four robotic control tasks. Further evaluations show improved physical consequence alignment, clean-noisy dynamics consistency, and causal evidence that dynamics information relevant to planning is preserved from collapse.