arXiv Open Access 2026

World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry

Yuejiang Liu Fan Feng Lingjing Kong Weifeng Lu Jinzhou Tang +4 lainnya
Lihat Sumber

Abstrak

General-purpose world models promise scalable policy evaluation, optimization, and planning, yet achieving the required level of robustness remains challenging. Unlike policy learning, which primarily focuses on optimal actions, a world model must be reliable over a much broader range of suboptimal actions, which are often insufficiently covered by action-labeled interaction data. To address this challenge, we propose World Action Verifier (WAV), a framework that enables world models to identify their own prediction errors and self-improve. The key idea is to decompose action-conditioned state prediction into two factors -- state plausibility and action reachability -- and verify each separately. We show that these verification problems can be substantially easier than predicting future states due to two underlying asymmetries: the broader availability of action-free data and the lower dimensionality of action-relevant features. Leveraging these asymmetries, we augment a world model with (i) a diverse subgoal generator obtained from video corpora and (ii) a sparse inverse model that infers actions from a subset of state features. By enforcing cycle consistency among generated subgoals, inferred actions, and forward rollouts, WAV provides an effective verification mechanism in under-explored regimes, where existing methods typically fail. Across nine tasks spanning MiniGrid, RoboMimic, and ManiSkill, our method achieves 2x higher sample efficiency while improving downstream policy performance by 18%.

Topik & Kata Kunci

Penulis (9)

Y

Yuejiang Liu

F

Fan Feng

L

Lingjing Kong

W

Weifeng Lu

J

Jinzhou Tang

K

Kun Zhang

K

Kevin Murphy

C

Chelsea Finn

Y

Yilun Du

Format Sitasi

Liu, Y., Feng, F., Kong, L., Lu, W., Tang, J., Zhang, K. et al. (2026). World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry. https://arxiv.org/abs/2604.01985

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2026
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓