OmniMol: Transferring Particle Physics Knowledge to Molecular Dynamics with Point-Edge Transformers
Abstrak
We present OmniMol, a state-of-the-art transformer-based small molecule machine-learned interatomic potential (MLIP). OmniMol is built by adapting Omnilearned, a foundation model for particle jets found in high-energy physics (HEP) experiments such as at the Large Hadron Collider (LHC). Omnilearned is built with a Point-Edge-Transformer (PET) and pre-trained using a diverse set of one billion particle jets. It includes an interaction-matrix attention bias that injects pairwise sub-nuclear (HEP) or atomic (molecular-dynamics) physics directly into the transformer's attention logits, steering the network toward physically meaningful neighborhoods without sacrificing expressivity. We demonstrate OmniMol using the oMol dataset and find excellent performance even with relatively few examples for fine-tuning. This study lays the foundation for building interdisciplinary connections, given datasets represented as collections of point clouds.
Topik & Kata Kunci
Penulis (4)
Ibrahim Elsharkawy
Vinicius Mikuni
W. Bhimji
Benjamin Nachman
Akses Cepat
PDF tidak tersedia langsung
Cek di sumber asli →- Tahun Terbit
- 2026
- Bahasa
- en
- Total Sitasi
- 2×
- Sumber Database
- Semantic Scholar
- Akses
- Open Access ✓