Learning Abstract World Models with a Group-Structured Latent Space
TLDR
Proposes learning abstract world models with group-structured latent spaces to impose geometric priors, improving transition prediction and RL in symmetric environments.
Reasoning
The paper introduces a novel method to incorporate geometric priors via group-structured latent spaces, showing improved transition prediction and RL performance in environments with rotational/translational symmetries. Strengths include clear theoretical framing and empirical validation, but weaknesses are the reliance on known symmetries and evaluation only in simulated environments, limiting real-world applicability.
Read-first score
Read-first score 40.3, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 35.
Field roles
Rank sensitivity
Stability: volatile; rank range: 311.
Keyword Scores
Deep Analysis
Innovations
- Imposing geometric priors on the latent representation manifold of a learned transition model via group-structured latent space.
- Incorporating known symmetric structures (e.g., rotational, translational) through appropriate latent space and group actions to encode invariances.
- Allowing embedding of additional unstructured information alongside the structured symmetries.
- Demonstrating improved latent transition prediction, downstream RL performance, and simpler/disentangled representations compared to unstructured approaches.
Methodology
The paper proposes a framework that imposes geometric priors on the low-dimensional representation manifold of a learned transition model by designing a latent space with group structure (e.g., rotation/translation groups). This encodes prior knowledge about invariances in the environment, and also allows embedding of unstructured information. The model is evaluated on environments with rotational and translational features, including first-person views of 3D environments, using baselines of fully unstructured approaches. Metrics include prediction accuracy of the latent transition model, downstream RL task performance, and representation simplicity/disentanglement.
Key Results
The group-structured latent space yields better predictions of the latent transition model than fully unstructured approaches, and leads to improved learning on downstream RL tasks. Additionally, the representations are simpler and more disentangled.