Principia: Relational Physics Tests for Video Models
TLDR
Introduces Principia, a benchmark measuring Newtonian physics in video models via calibration-independent relational consistency between paired objects; state-of-the-art generators score low.
Reasoning
Strengths include a clever calibration-independent relational formulation, broad physical phenomena, and real-world controlled scenes that expose failures despite high VBench scores. Weaknesses include limited methodological detail in the abstract and minimal discussion of evaluation limitations or comparison to prior benchmarks.
Read-first score
Read-first score 20.9, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 17.
Field roles
Frontier
Rank sensitivity
Stability: volatile; rank range: 105.