arXiv Open Access 2024

Cheetah: Natural Language Generation for 517 African Languages

Ife Adebara AbdelRahim Elmadany Muhammad Abdul-Mageed
Lihat Sumber

Abstrak

Low-resource African languages pose unique challenges for natural language processing (NLP) tasks, including natural language generation (NLG). In this paper, we develop Cheetah, a massively multilingual NLG language model for African languages. Cheetah supports 517 African languages and language varieties, allowing us to address the scarcity of NLG resources and provide a solution to foster linguistic diversity. We demonstrate the effectiveness of Cheetah through comprehensive evaluations across six generation downstream tasks. In five of the six tasks, Cheetah significantly outperforms other models, showcasing its remarkable performance for generating coherent and contextually appropriate text in a wide range of African languages. We additionally conduct a detailed human evaluation to delve deeper into the linguistic capabilities of Cheetah. The introduction of Cheetah has far-reaching benefits for linguistic diversity. By leveraging pretrained models and adapting them to specific languages, our approach facilitates the development of practical NLG applications for African communities. The findings of this study contribute to advancing NLP research in low-resource settings, enabling greater accessibility and inclusion for African languages in a rapidly expanding digital landscape. We publicly release our models for research.

Topik & Kata Kunci

Penulis (3)

I

Ife Adebara

A

AbdelRahim Elmadany

M

Muhammad Abdul-Mageed

Format Sitasi

Adebara, I., Elmadany, A., Abdul-Mageed, M. (2024). Cheetah: Natural Language Generation for 517 African Languages. https://arxiv.org/abs/2401.01053

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2024
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓