X-Cache: Cross-Chunk Block Caching for Few-Step Autoregressive World Models Inference
TLDR
X-Cache accelerates autoregressive world model inference by caching across generation chunks, enabling real-time simulation for autonomous driving.
Reasoning
The paper presents a novel caching method that reduces inference cost for interactive world models, with a dual-metric gating mechanism and KV cache management. Its strength lies in addressing a practical bottleneck, but the abstract is cut off, limiting full evaluation of results and limitations.
Read-first score
Read-first score 57, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 53.
Field roles
Rank sensitivity
Stability: volatile; rank range: 416.
Keyword Scores
Deep Analysis
Innovations
- Cross-chunk block caching that caches across consecutive generation chunks rather than across denoising steps
- Dual-metric gating mechanism using a structure- and action-aware block-input fingerprint to decide recompute or reuse
- Identification of KV update chunks with unconditional full computation to prevent error propagation in the autoregressive KV cache
Methodology
X-Cache is a training-free acceleration method for few-step autoregressive world models. It maintains per-block residual caches that persist across generation chunks and uses a dual-metric gating mechanism with a structure- and action-aware block-input fingerprint to decide whether to recompute or reuse cached residuals. To prevent approximation errors from contaminating the autoregressive KV cache, it identifies KV update chunks and unconditionally forces full computation on them.
Key Results
On the X-world production multi-camera action-conditioned driving world model, X-Cache achieves 71% block skip rate and 2.6x wall-clock speedup while maintaining minimum degradation.
Limitations
- The method is designed specifically for few-step autoregressive world models with multi-block causal DiT and rolling KV cache, limiting generalizability to other video generation paradigms.
- The abstract does not quantify the degradation or provide failure cases, leaving uncertainty about the trade-off between speedup and quality.