arXiv Open Access 2025

Training a Foundation Model for Materials on a Budget

Teddy Koker Mit Kotak Tess Smidt
Lihat Sumber

Abstrak

Foundation models for materials modeling are advancing quickly, but their training remains expensive, often placing state-of-the-art methods out of reach for many research groups. We introduce Nequix, a compact E(3)-equivariant potential that pairs a simplified NequIP design with modern training practices, including equivariant root-mean-square layer normalization and the Muon optimizer, to retain accuracy while substantially reducing compute requirements. Nequix has 700K parameters and was trained in 100 A100 GPU-hours. On the Matbench-Discovery and MDR Phonon benchmarks, Nequix ranks third overall while requiring a 20 times lower training cost than most other methods, and it delivers two orders of magnitude faster inference speed than the current top-ranked model. We release model weights and fully reproducible codebase at https://github.com/atomicarchitects/nequix.

Topik & Kata Kunci

Penulis (3)

T

Teddy Koker

M

Mit Kotak

T

Tess Smidt

Format Sitasi

Koker, T., Kotak, M., Smidt, T. (2025). Training a Foundation Model for Materials on a Budget. https://arxiv.org/abs/2508.16067

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2025
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓