VLM-DEWM: Dynamic External World Model for Verifiable and Resilient Vision-Language Planning in Manufacturing
TLDR
VLM-DEWM decouples VLM reasoning from world-state management using a persistent external world model, improving state tracking and recovery in manufacturing.
Reasoning
The paper presents a novel cognitive architecture that addresses stateless operation and opaque reasoning in VLM-based planning, with strong empirical results on real robots. However, the approach is domain-specific to manufacturing and lacks discussion of limitations or generalization.
Read-first score
Read-first score 56.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 35.
Field roles
Rank sensitivity
Stability: volatile; rank range: 405.
Keyword Scores
Deep Analysis
Innovations
- Decoupling VLM reasoning from world-state management via a persistent, queryable Dynamic External World Model (DEWM)
- Externalizable Reasoning Trace (ERT) comprising action proposal, world belief, and causal assumption for structured decision validation
- Discrepancy analysis between predicted and observed states enabling targeted recovery instead of global replanning
Methodology
VLM-DEWM is a cognitive architecture that separates VLM reasoning from world-state management using a Dynamic External World Model (DEWM). Each VLM decision is structured into an Externalizable Reasoning Trace (ERT) containing action proposal, world belief, and causal assumption, which is validated against DEWM before execution. When failures occur, discrepancy analysis between predicted and observed states triggers targeted recovery. The system is evaluated on multi-station assembly, large-scale facility exploration, and real-robot recovery under induced failures, compared against baseline memory-augmented VLM systems.
Key Results
VLM-DEWM improves state-tracking accuracy from 56% to 93%, increases recovery success rate from below 5% to 95%, and significantly reduces computational overhead through structured memory.