MAIA: Anticipating Interaction Anomalies in Contact-Rich Manipulation via Multimodal World Models
TLDR
MAIA uses a multimodal vision-action-force world model and the CRIA dataset to anticipate anomalies in contact-rich manipulation, improving task success via early warnings.
Reasoning
The paper introduces a novel anomaly anticipation framework with a real-world multimodal dataset and demonstrates clear gains in discrimination accuracy, lead time, and task success. Weaknesses include limited discussion of generalizability beyond the 18 evaluated tasks and reliance on abstract-level claims without visible implementation details.
Read-first score
Read-first score 43.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 48.
Field roles
Rank sensitivity
Stability: volatile; rank range: 761.
Keyword Scores
Deep Analysis
Innovations
- Multimodal vision-action-force world model that predicts visual and force responses of planned actions for anomaly anticipation
- Lightweight anomaly head that predicts impending interaction anomalies from learned nominal interaction dynamics
- CRIA dataset: a real-world multimodal dataset of 2,852 trajectories across 18 contact-rich manipulation tasks with frame-level anomaly annotations
- Anomaly-aware action selection using anticipation predictions to improve task success without retraining the manipulation policy
Methodology
MAIA uses a vision-action-force world model to learn nominal interaction dynamics and predict visual and force responses of planned actions, paired with a lightweight anomaly head for detecting impending anomalies. Evaluation uses the introduced CRIA dataset, spanning 2,852 real-world trajectories across 18 contact-rich manipulation tasks, with experiments on both seen and novel tasks and comparison against representative baselines. Metrics include anomaly discrimination accuracy via bACC and median anticipation lead time, plus end-to-end task success when predictions are used for action selection.
Key Results
MAIA achieved bACC scores of 0.765 on seen tasks and 0.710 on novel tasks, with median anticipation lead times of 28.0 and 25.1 steps, respectively. Anomaly-aware action selection improved end-to-end task success from 52.6% to 61.5% without retraining the underlying manipulation policy.