arXiv Open Access 2026

Grounding World Simulation Models in a Real-World Metropolis

Junyoung Seo Hyunwook Choi Minkyung Kwon Jinhyeok Choi Siyoon Jin +8 lainnya
Lihat Sumber

Abstrak

What if a world simulation model could render not an imagined environment but a city that actually exists? Prior generative world models synthesize visually plausible yet artificial environments by imagining all content. We present Seoul World Model (SWM), a city-scale world model grounded in the real city of Seoul. SWM anchors autoregressive video generation through retrieval-augmented conditioning on nearby street-view images. However, this design introduces several challenges, including temporal misalignment between retrieved references and the dynamic target scene, limited trajectory diversity and data sparsity from vehicle-mounted captures at sparse intervals. We address these challenges through cross-temporal pairing, a large-scale synthetic dataset enabling diverse camera trajectories, and a view interpolation pipeline that synthesizes coherent training videos from sparse street-view images. We further introduce a Virtual Lookahead Sink to stabilize long-horizon generation by continuously re-grounding each chunk to a retrieved image at a future location. We evaluate SWM against recent video world models across three cities: Seoul, Busan, and Ann Arbor. SWM outperforms existing methods in generating spatially faithful, temporally consistent, long-horizon videos grounded in actual urban environments over trajectories reaching hundreds of meters, while supporting diverse camera movements and text-prompted scenario variations.

Topik & Kata Kunci

Penulis (13)

J

Junyoung Seo

H

Hyunwook Choi

M

Minkyung Kwon

J

Jinhyeok Choi

S

Siyoon Jin

G

Gayoung Lee

J

Junho Kim

J

JoungBin Lee

G

Geonmo Gu

D

Dongyoon Han

S

Sangdoo Yun

S

Seungryong Kim

J

Jin-Hwa Kim

Format Sitasi

Seo, J., Choi, H., Kwon, M., Choi, J., Jin, S., Lee, G. et al. (2026). Grounding World Simulation Models in a Real-World Metropolis. https://arxiv.org/abs/2603.15583

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2026
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓