World Model Implanting for Test-time Adaptation of Embodied Agents
TLDR
WorMI combines LLMs with domain-specific world models via test-time composition for cross-domain adaptation in embodied AI.
Reasoning
The paper presents a novel framework (WorMI) that effectively integrates LLMs with retrieved world models for zero-shot and few-shot adaptation, validated on two benchmarks. However, it lacks real-world experiments and the abstract does not detail limitations or comparisons to non-LLM baselines.
Read-first score
Read-first score 45.2, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 26.
Field roles
Rank sensitivity
Stability: volatile; rank range: 357.
Keyword Scores
Deep Analysis
Innovations
- World model implanting framework (WorMI) that combines LLM reasoning with domain-specific world models via test-time composition
- Prototype-based world model retrieval using efficient trajectory-based abstract representation matching
- World-wise compound attention method that integrates knowledge from retrieved world models and aligns their intermediate representations with the reasoning model
Methodology
The WorMI framework enables test-time composition of an LLM-based reasoning model with independently learned, domain-specific world models. It uses a prototype-based retrieval approach that matches abstract trajectory representations to select relevant world models, and a world-wise compound attention mechanism to fuse domain-specific knowledge and align representations within the agent's policy.
Key Results
On VirtualHome and ALFWorld benchmarks, WorMI achieves superior zero-shot and few-shot performance compared to several LLM-based approaches across a range of unseen domains.