ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
TLDR
ActWorld extends navigation-centric world models to support object interaction via action-aware memory and a new dataset.
Reasoning
Strengths: addresses the navigation-interaction gap with a novel hierarchical memory and a 100K interaction video dataset. Weaknesses: abstract lacks detailed experimental results and scalability discussion.
Read-first score
Read-first score 63.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 45.
Field roles
Rank sensitivity
Stability: volatile; rank range: 403.
Keyword Scores
Deep Analysis
Innovations
- Extending navigation-centric world models to support mid-rollout object interaction within a chunk-autoregressive framework
- Construction of a 100K interaction video dataset with per-chunk captions via chain-of-thought reasoning
- Hierarchical action-aware memory design that routes history compression by interaction importance, complemented by a persistent memory bank for event-update and object-identity tokens
Methodology
ActWorld uses a chunk-autoregressive framework to generate interactive world models. It addresses the data bottleneck by constructing a 100K interaction video dataset annotated with per-chunk captions via chain-of-thought reasoning. To overcome the memory bottleneck, it introduces a hierarchical action-aware memory that compresses history based on interaction importance and maintains a persistent memory bank for event-update and object-identity tokens across long rollouts.
Key Results
ActWorld supports both flexible navigation and rich object interaction within a single model, substantially improving interaction fidelity over navigation-only baselines without sacrificing viewpoint control.