Latent Geometry Beyond Search: Amortizing Planning in World Models
TLDR
Amortizes planning in world models by learning a latent inverse-dynamics mapping, replacing online search with a lightweight model that matches CEM performance at 100-130x lower cost.
Reasoning
The paper presents a novel method for amortizing planning in world models, with strong empirical results across multiple benchmarks. However, it lacks real-world experiments and does not address generative or video world models directly, limiting the scope of its claims.
Read-first score
Read-first score 57.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 25.
Field roles
Rank sensitivity
Stability: volatile; rank range: 572.
Keyword Scores
Deep Analysis
Innovations
- Amortizing planning into a latent inverse-dynamics mapping instead of requiring online search
- Goal-Conditioned Inverse Dynamics Model (GC-IDM) that maps current latent state, goal latent state, and remaining horizon directly to the next action
- Demonstrating that sufficiently structured latent spaces can shift part of the planning burden from online optimization to learned inference
Methodology
The study uses a pretrained LeWorldModel whose latent geometry is regularized for smoothness and uniformity. Instead of iterative planning, they introduce a lightweight Goal-Conditioned Inverse Dynamics Model (GC-IDM) that takes the current latent state, goal latent state, and remaining horizon as input and outputs the next action. Evaluation is conducted across four benchmark environments (navigation, contact-rich manipulation, continuous control) against test-time planners including CEM, MPPI, iCEM, and gradient-based methods.
Key Results
The GC-IDM matches or exceeds CEM in seven of eight environment-protocol settings while reducing per-decision cost by 100-130x. A broader sweep over test-time planners confirms that this result is not specific to a particular optimizer.
Limitations
- The approach relies on a pretrained world model with specific latent geometry regularization (smoothness and uniformity), which may not generalize to other world models or latent spaces
- Evaluation is limited to four benchmark environments; scalability to more complex or diverse tasks is not demonstrated
- The amortization may fail if the latent representation does not locally encode the structure needed for planning