Network-Efficient World Model Token Streaming
TLDR
Proposes an adaptive keyframe-delta streaming protocol for discrete world model tokens, improving rate-distortion and perplexity under packet loss.
Reasoning
Strengths include a novel online algorithm for efficient streaming of world model states with clear experimental improvements. Weaknesses are the narrow driving domain focus and lack of comparison to other compression methods or full world model evaluation.
Read-first score
Read-first score 48.7, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 31.
Field roles
Rank sensitivity
Stability: volatile; rank range: 230.
Keyword Scores
Deep Analysis
Innovations
- Stride-16 VQ-U-Net tokenizer with codebook size 8,192 mapping 288x512 frames to 18x32 token grids (576 tokens/frame, 936 bytes/frame under fixed-length coding)
- Fully online, label-free keyframe-delta protocol that prioritizes delta updates via cosine distance in codebook embedding space and triggers keyframes adaptively using a Hamming-drift threshold
- Consistent improvement in rate distortion frontier over periodic keyframes at matched bitrates, with up to 7.2% reduction in embedding distortion and 6.3% improvement in perplexity
Methodology
The paper proposes a stride-16 VQ-U-Net tokenizer that maps each 288x512 frame to an 18x32 grid of token IDs (576 tokens/frame) using a codebook of size 8,192, resulting in 936 bytes/frame under fixed-length coding. A keyframe-delta protocol is employed under strict per-message payload budgets and packet loss, with a fully online, label-free algorithm that prioritizes delta updates via cosine distance in codebook embedding space and triggers keyframes adaptively using a Hamming-drift threshold. The method is evaluated against periodic keyframes at matched bitrates using rate distortion metrics and perplexity of a lightweight next-token predictor conditioned on receiver states.
Key Results
At 0.024 Mb/s (200-byte budget), dynamic-only embedding distortion drops from 0.0712 to 0.0661 (7.2% improvement); at 0.036 Mb/s (400-byte budget) from 0.0427 to 0.0407 (4.8%). Under 10% delta packet loss at 200 bytes, dynamic-only distortion is 0.0757 versus 0.0789 for periodic baseline. Perplexity improves from 206.0 to 193.1 (6.3%) at 0.024 Mb/s and from 158.9 to 155.6 (2.1%) at 0.036 Mb/s.