arXiv Open Access 2024

WildFusion: Individual Animal Identification with Calibrated Similarity Fusion

Vojtěch Cermak Lukas Picek Lukáš Adam Lukáš Neumann Jiří Matas
Lihat Sumber

Abstrak

We propose a new method - WildFusion - for individual identification of a broad range of animal species. The method fuses deep scores (e.g., MegaDescriptor or DINOv2) and local matching similarity (e.g., LoFTR and LightGlue) to identify individual animals. The global and local information fusion is facilitated by similarity score calibration. In a zero-shot setting, relying on local similarity score only, WildFusion achieved mean accuracy, measured on 17 datasets, of 76.2%. This is better than the state-of-the-art model, MegaDescriptor-L, whose training set included 15 of the 17 datasets. If a dataset-specific calibration is applied, mean accuracy increases by 2.3% percentage points. WildFusion, with both local and global similarity scores, outperforms the state-of-the-art significantly - mean accuracy reached 84.0%, an increase of 8.5 percentage points; the mean relative error drops by 35%. We make the code and pre-trained models publicly available5, enabling immediate use in ecology and conservation.

Topik & Kata Kunci

Penulis (5)

V

Vojtěch Cermak

L

Lukas Picek

L

Lukáš Adam

L

Lukáš Neumann

J

Jiří Matas

Format Sitasi

Cermak, V., Picek, L., Adam, L., Neumann, L., Matas, J. (2024). WildFusion: Individual Animal Identification with Calibrated Similarity Fusion. https://arxiv.org/abs/2408.12934

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2024
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓