Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control
TLDR
Enfold transfers world generative model computation into a representation predicted from current context, enabling efficient embodied control without executing the generator at deployment.
Reasoning
The paper presents a novel approach to reuse the internal computation of world generative models for representation learning, showing strong empirical results with significant latency reductions. However, the abstract lacks methodological details and explicit limitations, though the real-robot experiments strengthen its claims.
Read-first score
Read-first score 42.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 50.
Field roles
Rank sensitivity
Stability: volatile; rank range: 379.
Keyword Scores
Deep Analysis
Innovations
- Internalizing future-generative computation into a present-only representation by distilling multi-level intermediate states of a world generator processing the observed future.
- Training a current-only encoder supervised by generator states, with the representation fed back to condition future generation and read by task heads without allowing task gradients to reshape the encoder.
- Eliminating the generator at deployment to achieve 3.7× (Enfold) and 10.1× (Enfold-Flash) action latency reduction while maintaining strong control performance.
- Learning representations that suppress nuisance variation and preferentially capture changes that emerge over longer horizons.
- Demonstrating adaptive behavior under human interventions where both the generated continuation and executed actions change, inconsistent with fixed trajectory replay.
Methodology
Enfold trains a current-only encoder (from visual context and language instruction) to match the multi-level intermediate states of a world generator that processes the observed future sequence. The learned representation conditions future generation and is used by task heads for action prediction, but task gradients do not update the encoder. At test time, action prediction uses only the encoder without executing the generator, enabling fast inference.
Key Results
Enfold achieves strong control on LIBERO, RoboTwin2.0, and real-robot tasks, reducing action latency by 3.7× relative to Fast-WAM (Enfold) and 10.1× (Enfold-Flash); the representation suppresses nuisance variation, captures long-horizon changes, and adapts both generated continuations and actions when the current scene is altered by human intervention.