WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory

arXiv 2026 45 method, system

TLDR

WorldDirector decouples motion from visual generation using LLM-coordinated 3D trajectories for controllable video world models with persistent dynamic object memory.

Reasoning

Strengths: novel decoupling of semantic motion and visual generation, enabling persistent object identity and controllability. Weaknesses: abstract lacks details on evaluation metrics and real-world validation; reliance on LLM may introduce latency or inconsistency.

Read-first score

Read-first score 45, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 52.

Recency 6%

100

Uses a gentle age decay so recent papers surface without erasing older foundations. 2026

Topical relevance 29%

74.3

Uses existing LLM keyword relevance scores normalized to 0-100. world model,world simulator,generative world model,interactive world model,video world model,world dynamics prediction,model-based reinforcement learning world model

Methodology quality 18%

Screens visible abstract and analysis fields for experiment, dataset, baseline, metric, and limitation evidence. markers=experiment,result

Reproducibility 18%

Screens links and visible text for paper, code, dataset, artifact, and repository signals. pdf=True; code=False; dataset=False; markers=github

Citation impact 18%

Uses OpenAlex-shaped citation metadata as a bibliometric attention signal, separate from paper quality. cited_by_count=0

Citation velocity 12%

Citation velocity estimates citations per publication-year to reduce old-paper bias. velocity=0.00

Field roles

Frontier

Rank sensitivity

Stability: volatile; rank range: 432.

Keyword Scores

world simulator

video world model

world model

generative world model

world dynamics prediction

interactive world model

model-based reinforcement learning world model

Deep Analysis

Innovations

Decoupling semantic motion orchestration from visual generation
Using an LLM to coordinate 3D trajectories with camera movements as control signals for video generation
Persistent dynamic object memory that preserves visual identities of entities after prolonged occlusion

Methodology

WorldDirector decouples motion orchestration from visual generation: an LLM coordinates 3D object trajectories and camera movements, which serve as control signals for a video generator. This ensures physical logic and appearance stability, enabling persistent memory of dynamic objects even when they leave and re-enter the scene.

Key Results

The method synthesizes complex, extended events with unprecedented controllability and persistent dynamic object memory, preserving exact visual identities after prolonged out-of-view periods.

Resources

Paper