Semantic Scholar Open Access 2023 4 sitasi

Is German secretly a Slavic language? What BERT probing can tell us about language groups

A. Mysiak J. Cyranka

Lihat Sumber DOI

Abstrak

In the light of recent developments in NLP, the problem of understanding and interpreting large language models has gained a lot of urgency. Methods developed to study this area are subject to considerable scrutiny. In this work, we take a closer look at one such method, the structural probe introduced by Hewitt and Manning (2019). We run a series of experiments involving multiple languages, focusing principally on the group of Slavic languages. We show that probing results can be seen as a reflection of linguistic classification, and conclude that multilingual BERT learns facts about languages and their groups.

Penulis (2)

A. Mysiak

J. Cyranka

Format Sitasi

APA MLA BibTeX

Mysiak, A., Cyranka, J. (2023). Is German secretly a Slavic language? What BERT probing can tell us about language groups. https://doi.org/10.18653/v1/2023.bsnlp-1.11

Akses Cepat

Lihat di Sumber doi.org/10.18653/v1/2023.bsnlp-1.11

Informasi Jurnal

Tahun Terbit: 2023
Bahasa: en
Total Sitasi: 4×
Sumber Database: Semantic Scholar
DOI: 10.18653/v1/2023.bsnlp-1.11
Akses: Open Access ✓