Planning in 8 Tokens: A Compact Discrete Tokenizer for Latent World Model
TLDR
CompACT tokenizer compresses observations into 8 tokens for faster, competitive planning in latent world models.
Reasoning
The paper presents a novel discrete tokenizer that significantly reduces computational cost for planning in world models, with strong empirical results showing orders-of-magnitude speedup. However, the abstract lacks explicit real-world evaluation and does not detail limitations or comparisons to other tokenization methods.
Read-first score
Read-first score 48.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 35.
Field roles
Rank sensitivity
Stability: volatile; rank range: 524.
Keyword Scores
Deep Analysis
Innovations
- CompACT discrete tokenizer compresses each observation into as few as 8 tokens, drastically reducing computational cost.
- Enables orders-of-magnitude faster planning while maintaining competitive planning performance.
- Provides a practical step toward real-world deployment of world models for decision-time planning.
Methodology
The paper proposes CompACT, a discrete tokenizer that compresses each observation into 8 tokens. An action-conditioned world model is built using this tokenizer to perform planning. The approach is evaluated on planning tasks, comparing against conventional tokenizers that encode observations into hundreds of tokens.
Key Results
CompACT achieves competitive planning performance with orders-of-magnitude faster planning compared to conventional tokenizers.