Anisotropic Representations Improve Planning in JEPA World Models
TLDR
Introduces AnisoWM with ΛReg, a learnable diagonal covariance target that improves planning in JEPA world models by aligning latent representation geometry with task costs.
Reasoning
The paper provides a focused theoretical analysis of how representation geometry affects planning costs and supports it with empirical gains across four visual control environments. However, it relies only on simulated control benchmarks and does not demonstrate real-world deployment or compare with broader generative world model approaches.
Read-first score
Read-first score 36, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 39.
Field roles
Rank sensitivity
Stability: volatile; rank range: 352.
Keyword Scores
Deep Analysis
Innovations
- Identifies that isotropic Gaussian regularization can produce task-misaligned latent planning geometry even with accurate prediction and non-collapsed representations.
- Introduces AnisoWM with ΛReg, replacing the fixed isotropic Gaussian target with a learnable diagonal covariance under fixed-trace and anisotropy constraints.
- Provides analysis of prediction-driven allocation of target variance and conditions under which the induced metric reduces planning regret.
Methodology
The paper proposes AnisoWM, a latent world model that uses ΛReg with a learnable diagonal covariance target under fixed-trace and anisotropy constraints, while keeping the prediction objective, predictor architecture, and Euclidean planner unchanged. It includes theoretical analysis of target variance allocation and planning regret, and evaluates planning success and latent cost-task agreement across four visual control environments compared to LeWorldModel.
Key Results
AnisoWM improves planning success over LeWorldModel in all four visual control environments, and its latent planning cost shows better agreement with task outcomes.