Causal Object-Centric Models for Planning with Monte Carlo Tree Search
TLDR
COMET combines object-centric representations with Monte Carlo Tree Search for efficient model-based reinforcement learning.
Reasoning
The paper introduces a novel architecture that integrates a frozen object-centric encoder with a transformer world model and action-slot fusion, achieving strong early training performance across diverse benchmarks. However, the reliance on a frozen encoder and limited evaluation to early training stages may constrain generalizability.
Read-first score
Read-first score 60.9, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 50.
Field roles
Rank sensitivity
Stability: volatile; rank range: 471.
Keyword Scores
Deep Analysis
Innovations
- COMET algorithm combining Monte Carlo Tree Search with slot-structured latent space
- Frozen unsupervised object-centric encoder paired with transformer-based world model
- Action-slot fusion mechanism for binding actions to objects in slot transition prediction
- Object-causal attention with learned per-slot relevance scores for policy and value heads
Methodology
COMET uses a frozen unsupervised object-centric encoder to produce slot representations, then a transformer-based world model with action-slot fusion to predict slot transitions. Policy and value heads employ object-causal attention modulated by learned per-slot relevance scores. The model is trained in a model-based RL setting with Monte Carlo Tree Search in the latent space.
Key Results
Across eight visually and dynamically diverse tasks from the Object-Centric Visual RL benchmark, ManiSkill, Robosuite, and VizDoom, COMET achieves a higher mean normalized score during the early stages of training compared to object-centric and monolithic baselines.