EgoForge: Goal-Directed Egocentric World Simulator
TLDR
EgoForge is a goal-directed egocentric world simulator generating coherent first-person video rollouts from a single egocentric image, instruction, and optional exocentric view, using GRAFT diffusion refinement.
Reasoning
The paper introduces a novel generative world-model approach for egocentric video, addressing challenges like viewpoint changes and latent intent with minimal inputs. Its strengths include a new trajectory-level diffusion refinement method and real-world smart-glasses validation, but the abstract lacks quantitative details and explicit limitations.
Read-first score
Read-first score 39.4, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 52.
Field roles
Rank sensitivity
Stability: volatile; rank range: 500.
Keyword Scores
Deep Analysis
Innovations
- EgoForge, an egocentric goal-directed world simulator that generates coherent first-person video rollouts from minimal static inputs: a single egocentric image, a high-level instruction, and an optional auxiliary exocentric view.
- GRAFT, a trajectory-level diffusion refinement method that uses positive and negative rollout distributions derived from goal, temporal, scene-consistency, and perceptual rewards to steer the diffusion velocity field toward coherent, goal-complete egocentric simulations.
- Operates without dense supervision such as camera trajectories, long video prefixes, or synchronized multi-camera capture, unlike prior egocentric approaches.
Methodology
EgoForge takes a single egocentric image, a high-level instruction, and an optional auxiliary exocentric view to generate first-person video rollouts. It employs GRAFT, a trajectory-level diffusion refinement method that steers the diffusion velocity field using positive and negative rollout distributions derived from goal, temporal, scene-consistency, and perceptual rewards.
Key Results
Extensive experiments show EgoForge achieves consistent gains in semantic alignment, geometric stability, and motion fidelity over strong baselines, and performs robustly in real-world smart-glasses experiments.