Object-Centric World Models for Causality-Aware Reinforcement Learning
TLDR
STICA uses object-centric Transformers as world models with causality-aware policy networks for sample-efficient RL on object-rich benchmarks.
Reasoning
The paper introduces a novel integration of object-centric representations and causality-aware decision-making, showing strong empirical results on benchmarks. However, it lacks real-world experiments and does not address scalability or limitations of the approach.
Read-first score
Read-first score 53.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 34.
Field roles
Rank sensitivity
Stability: volatile; rank range: 399.
Keyword Scores
Deep Analysis
Innovations
- Object-centric Transformers as the world model
- Causality-aware policy and value networks
- Token-level dynamics and interaction prediction
- Causality-guided decision-making via attention layers
Methodology
STICA represents each observation as a set of object-centric tokens, along with tokens for the agent action and the resulting reward. The world model, based on object-centric Transformers, predicts token-level dynamics and interactions. The policy and value networks estimate token-level cause-effect relations and incorporate them into attention layers to guide decision-making.
Key Results
On object-rich benchmarks, STICA consistently outperforms state-of-the-art agents in both sample efficiency and final performance.