A 3D Isovist World Model -- Revealing a City's Unseen Geometry and Its Emergent Cross-City Signature
TLDR
A world model predicting 3D isovist (navigable geometry) from past isovists and actions, revealing emergent cross-city spatial signatures.
Reasoning
Strengths: novel predictive target (3D isovist) avoids appearance bias and preserves 3D structure; uses depth residuals and self-rollout sampling. Weaknesses: limited to two cities; abstract ends abruptly, lacking explicit real-world evaluation or benchmark results.
Read-first score
Read-first score 56.3, weighted from topical fit, citation, graph, method, reproducibility, and recency signals. Original total remains 29.
Field roles
Rank sensitivity
Stability: volatile; rank range: 433.
Keyword Scores
Deep Analysis
Innovations
- Modeling navigable geometry as a 3D isovist (spherical visibility-depth map) instead of appearance or 2D occupancy grids.
- Depth residual formulation for prediction to preserve sharp building edges.
- Self-rollout scheduled sampling to keep corrupted context on the geometry manifold.
- Persistent latent bird's-eye-view spatial map for cross-path consistency.
- Emergent cross-city spatial signature decodable from temporal latents, showing city identity is learned in dynamics rather than appearance.
Methodology
The paper introduces an embodied world model that predicts the next 3D isovist from a short history of past isovists and a movement action. The prediction is formulated as a depth residual, trained with self-rollout scheduled sampling, and equipped with a persistent latent bird's-eye-view spatial map. The model is trained on data from Manhattan and Paris.
Key Results
A single city-blind model trained on Manhattan and Paris develops a cross-city spatial signature, with city identity linearly decodable from its temporal latents far above single-frame baselines.
Limitations
- Only evaluated on two cities (Manhattan and Paris), so cross-city generalization to other urban forms is unverified.
- The isovist representation assumes static geometry, ignoring dynamic obstacles like vehicles or pedestrians.
- The method requires accurate depth sensing to compute isovists, which may not be available in all real-world settings.
- The persistent latent BEV map may introduce additional memory and computational overhead.