arXiv Open Access 2023

Sāmayik: A Benchmark and Dataset for English-Sanskrit Translation

Ayush Maheshwari Ashim Gupta Amrith Krishna Atul Kumar Singh Ganesh Ramakrishnan +2 lainnya
Lihat Sumber

Abstrak

We release Sāmayik, a dataset of around 53,000 parallel English-Sanskrit sentences, written in contemporary prose. Sanskrit is a classical language still in sustenance and has a rich documented heritage. However, due to the limited availability of digitized content, it still remains a low-resource language. Existing Sanskrit corpora, whether monolingual or bilingual, have predominantly focused on poetry and offer limited coverage of contemporary written materials. Sāmayik is curated from a diverse range of domains, including language instruction material, textual teaching pedagogy, and online tutorials, among others. It stands out as a unique resource that specifically caters to the contemporary usage of Sanskrit, with a primary emphasis on prose writing. Translation models trained on our dataset demonstrate statistically significant improvements when translating out-of-domain contemporary corpora, outperforming models trained on older classical-era poetry datasets. Finally, we also release benchmark models by adapting four multilingual pre-trained models, three of them have not been previously exposed to Sanskrit for translating between English and Sanskrit while one of them is multi-lingual pre-trained translation model including English and Sanskrit. The dataset and source code is present at https://github.com/ayushbits/saamayik.

Topik & Kata Kunci

Penulis (7)

A

Ayush Maheshwari

A

Ashim Gupta

A

Amrith Krishna

A

Atul Kumar Singh

G

Ganesh Ramakrishnan

G

G. Anil Kumar

J

Jitin Singla

Format Sitasi

Maheshwari, A., Gupta, A., Krishna, A., Singh, A.K., Ramakrishnan, G., Kumar, G.A. et al. (2023). Sāmayik: A Benchmark and Dataset for English-Sanskrit Translation. https://arxiv.org/abs/2305.14004

Akses Cepat

Lihat di Sumber
Informasi Jurnal
Tahun Terbit
2023
Bahasa
en
Sumber Database
arXiv
Akses
Open Access ✓