Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learning
TLDR
Discrete-WAM unifies vision and action tokens for world-policy learning in autonomous driving, enabling joint world modeling and policy generation via hierarchical token editing.
Reasoning
The paper introduces a novel discrete token alignment approach that jointly trains world and policy models, showing strong empirical results on autonomous driving benchmarks. However, the evaluation is limited to a single domain and lacks comparison with model-based RL methods, and the abstract does not discuss potential limitations or failure cases.
Read-first score
Read-first score 63.1, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 44.
Field roles
Rank sensitivity
Stability: volatile; rank range: 386.
Keyword Scores
Deep Analysis
Innovations
- Unified discrete vision-action token space representing visual observations, future states, high-level decisions, and ego actions
- Multi-task and multi-stage pretraining jointly training world modeling, world-policy modeling, and policy modeling
- Hierarchical decision prediction and parallel action-token editing with confidence-based scheduling for downstream planning
Methodology
Discrete-WAM encodes visual observations, future states, high-level decisions, and ego actions into a shared discrete token space. It then performs multi-task and multi-stage pretraining to jointly learn world modeling, world-policy modeling, and policy modeling, enabling action-conditioned future prediction to support policy generation. For planning, it decomposes policy generation into hierarchical decision prediction and parallel action-token editing, where a decision token provides a high-level skeleton and confidence-based scheduling refines dense future actions.
Key Results
On large-scale autonomous-driving benchmarks, Discrete-WAM achieves strong planning performance while supporting controllable future generation, counterfactual evaluation, surprise-based world-model analysis, and efficient parallel policy decoding.