arXiv Open Access 2025

Foundation Models and Transformers for Anomaly Detection: A Survey

Mouïn Ben Ammar Arturo Mendoza Nacim Belkhir Antoine Manzanera Gianni Franchi
Lihat Sumber

Abstrak

In line with the development of deep learning, this survey examines the transformative role of Transformers and foundation models in advancing visual anomaly detection (VAD). We explore how these architectures, with their global receptive fields and adaptability, address challenges such as long-range dependency modeling, contextual modeling and data scarcity. The survey categorizes VAD methods into reconstruction-based, feature-based and zero/few-shot approaches, highlighting the paradigm shift brought about by foundation models. By integrating attention mechanisms and leveraging large-scale pre-training, Transformers and foundation models enable more robust, interpretable, and scalable anomaly detection solutions. This work provides a comprehensive review of state-of-the-art techniques, their strengths, limitations, and emerging trends in leveraging these architectures for VAD.

Topik & Kata Kunci

Penulis (5)

M

Mouïn Ben Ammar

A

Arturo Mendoza

N

Nacim Belkhir

A

Antoine Manzanera

G

Gianni Franchi

Format Sitasi

Ammar, M.B., Mendoza, A., Belkhir, N., Manzanera, A., Franchi, G. (2025). Foundation Models and Transformers for Anomaly Detection: A Survey. https://arxiv.org/abs/2507.15905

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2025
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓