arXiv Open Access 2024

Grammatical Error Correction for Code-Switched Sentences by Learners of English

Kelvin Wey Han Chan Christopher Bryant Li Nguyen Andrew Caines Zheng Yuan
Lihat Sumber

Abstrak

Code-switching (CSW) is a common phenomenon among multilingual speakers where multiple languages are used in a single discourse or utterance. Mixed language utterances may still contain grammatical errors however, yet most existing Grammar Error Correction (GEC) systems have been trained on monolingual data and not developed with CSW in mind. In this work, we conduct the first exploration into the use of GEC systems on CSW text. Through this exploration, we propose a novel method of generating synthetic CSW GEC datasets by translating different spans of text within existing GEC corpora. We then investigate different methods of selecting these spans based on CSW ratio, switch-point factor and linguistic constraints, and identify how they affect the performance of GEC systems on CSW text. Our best model achieves an average increase of 1.57 $F_{0.5}$ across 3 CSW test sets (English-Chinese, English-Korean and English-Japanese) without affecting the model's performance on a monolingual dataset. We furthermore discovered that models trained on one CSW language generalise relatively well to other typologically similar CSW languages.

Topik & Kata Kunci

Penulis (5)

K

Kelvin Wey Han Chan

C

Christopher Bryant

L

Li Nguyen

A

Andrew Caines

Z

Zheng Yuan

Format Sitasi

Chan, K.W.H., Bryant, C., Nguyen, L., Caines, A., Yuan, Z. (2024). Grammatical Error Correction for Code-Switched Sentences by Learners of English. https://arxiv.org/abs/2404.12489

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2024
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓