Operator-on-F complements value-equivalence: a planning-time diagnostic for latent world models
TLDR
Introduces operator-on-F, a diagnostic for latent world models that measures planning-relevant errors, outperforming reward-prediction error in correlating with return loss.
Reasoning
Strengths: Novel diagnostic with strong empirical correlation (-0.90) to return loss, demonstrated on TD-MPC2 size sweep and cross-architecture comparison. Weaknesses: Limited to a single environment (cheetah-run) and small number of model sizes (n=5), lacking broader validation.
Read-first score
Read-first score 38.5, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 44.
Field roles
Rank sensitivity
Stability: volatile; rank range: 255.
Keyword Scores
Deep Analysis
Innovations
- Operator-on-F: a planning-time diagnostic that compares a model's k-step latent pushforward to the environment's on an observable subset F, using the model's own predictor, complementing value-equivalence.
Methodology
The diagnostic is evaluated on a TD-MPC2 model size sweep over the cheetah-run task, measuring operator error, reward-prediction error, and Bellman residual. Rank correlation between operator error and return loss is computed with anchor-bootstrap 95% confidence intervals, and a cross-architecture comparison between TD-MPC2 and a pure-SSL latent world model is performed.
Key Results
Reward-prediction error varies only ~3x across model sizes (0.028–0.091) and correlates weakly with return (Spearman -0.30), while operator error spans 0.28–2.62 and correlates with return loss at -0.90 (95% CI [-0.90, -0.70]). At 317M parameters, operator error spikes to 2.62 and planning return collapses to 0.9, despite reward error remaining in the same narrow range.