Mask World Model: Predicting What Matters for Robust Robot Policy Learning

arXiv 2026 59.6 method

TLDR

Mask World Model predicts semantic masks instead of RGB pixels using video diffusion, improving robot policy robustness and generalization.

Reasoning

The paper introduces a novel approach to world modeling by predicting semantic masks, which effectively filters out visual noise and improves generalization. Its strengths include strong empirical results on both simulation and real-world benchmarks, but the abstract lacks details on the model's scalability and computational cost.

Read-first score

Read-first score 59.6, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 51.

Recency 6%

100

Uses a gentle age decay so recent papers surface without erasing older foundations. 2026

Methodology quality 18%

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=benchmark,evaluation,experiment,metric,result

Topical relevance 29%

72.9

Uses existing LLM keyword relevance scores normalized to 0-100. world model,world simulator,generative world model,interactive world model,video world model,world dynamics prediction,model-based reinforcement learning world model

Citation impact 18%

62.7

Uses OpenAlex-shaped citation metadata as a bibliometric attention signal, separate from paper quality. citation_normalized_percentile=0.62697724

Reproducibility 18%

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=False; dataset=False; markers=none

Citation velocity 12%

Citation velocity estimates citations per publication-year to reduce old-paper bias. velocity=0.00

Field roles

FrontierBridgeMethodology anchor

Rank sensitivity

Stability: volatile; rank range: 374.

Keyword Scores

world model

video world model

world dynamics prediction

generative world model

model-based reinforcement learning world model

world simulator

interactive world model

Deep Analysis

Innovations

Predicting semantic masks instead of RGB pixels in world models to filter visual noise
Imposing a geometric information bottleneck to capture essential physical dynamics and contact relations
Integrating mask dynamics backbone with a diffusion-based policy head for robust end-to-end control

Methodology

The Mask World Model (MWM) leverages video diffusion architectures to predict the evolution of semantic masks rather than pixels, imposing a geometric information bottleneck that forces the model to capture essential physical dynamics and contact relations while filtering out visual noise. This mask dynamics backbone is seamlessly integrated with a diffusion-based policy head to enable robust end-to-end control.

Key Results

MWM significantly outperforms state-of-the-art RGB-based world models on the LIBERO and RLBench simulation benchmarks, and real-world experiments with random token pruning demonstrate superior generalization capabilities and robust resilience to texture information loss.

Resources

Paper