Render, Don't Decode: Weight-Space World Models with Latent Structural Disentanglement
TLDR
NOVA uses weight-space implicit neural representations to render world states, eliminating decoder bottlenecks and enabling disentangled scene editing.
Reasoning
The paper introduces a novel framework that replaces traditional latent decoders with analytically rendered INRs, achieving compactness and zero-shot super-resolution. Its strengths include strong empirical validation on challenging datasets and unsupervised disentanglement of structural components. Weaknesses are the lack of explicit real-world deployment details and limited discussion of scalability beyond single GPU.
Read-first score
Read-first score 58.3, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 54.
Field roles
Rank sensitivity
Stability: volatile; rank range: 451.
Keyword Scores
Deep Analysis
Innovations
- Representing world model state as weights and biases of an auxiliary coordinate-based implicit neural representation (INR) instead of opaque latent codes
- Analytic rendering of the INR state to eliminate the decoder bottleneck, enabling compactness, portability, and zero-shot super-resolution
- Disentanglement of structural scene components (background, foreground, inter-frame motion) without auxiliary losses or adversarial objectives
- Distillation into a context-dependent video generator via an action-matching objective
Methodology
NOVA models the system state as the weights and biases of a coordinate-based implicit neural representation (INR), which is analytically rendered to produce observations without a heavy decoder. The framework uses an action-matching objective to distill the world model into a controllable video generator, and achieves structural disentanglement without auxiliary losses.
Key Results
The framework achieves strong controllable forecasting on several challenging datasets while operating on a single consumer GPU at approximately 40 million parameters, and enables zero-shot super-resolution and editable scene components.