Value-guided action planning with JEPA world models
TLDR
Enhances JEPA world models for action planning by shaping representation space to approximate value functions, improving performance on simple control tasks.
Reasoning
The paper presents a novel method to integrate value-guided planning into JEPA world models, which is a clear strength. However, the evaluation is limited to simple control tasks, and there is no evidence of real-world applicability or scalability to complex environments.
Read-first score
Read-first score 46.9, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 27.
Field roles
Rank sensitivity
Stability: volatile; rank range: 464.
Keyword Scores
Deep Analysis
Innovations
- Shaping the representation space of JEPA world models so that the negative goal-conditioned value function for a reaching cost is approximated by a distance (or quasi-distance) between state embeddings.
- A practical method to enforce this constraint during training of JEPA models.
- Demonstration of significantly improved planning performance compared to standard JEPA models on simple control tasks.
Methodology
The approach builds on Joint-Embedded Predictive Architectures (JEPA) and modifies the training objective to enforce that the distance between state embeddings approximates the negative goal-conditioned value function for a reaching cost. The method is evaluated on simple control tasks by comparing planning performance against standard JEPA baselines.
Key Results
The proposed value-guided planning with JEPA world models leads to significantly improved planning performance compared to standard JEPA models on simple control tasks.
Limitations
- Only evaluated on simple control tasks, leaving generalization to more complex environments unaddressed.
- The method assumes a reaching cost structure for the goal-conditioned value function, which may not hold for all tasks.