arXiv Open Access 2019

A Comparative Study on Vocabulary Reduction for Phrase Table Smoothing

Yunsu Kim Andreas Guta Joern Wuebker Hermann Ney

Lihat Sumber

Abstrak

This work systematically analyzes the smoothing effect of vocabulary reduction for phrase translation models. We extensively compare various word-level vocabularies to show that the performance of smoothing is not significantly affected by the choice of vocabulary. This result provides empirical evidence that the standard phrase translation model is extremely sparse. Our experiments also reveal that vocabulary reduction is more effective for smoothing large-scale phrase tables.

Topik & Kata Kunci

cs.CL

Penulis (4)

Yunsu Kim

Andreas Guta

Joern Wuebker

Hermann Ney

Format Sitasi

APA MLA BibTeX

Kim, Y., Guta, A., Wuebker, J., Ney, H. (2019). A Comparative Study on Vocabulary Reduction for Phrase Table Smoothing. https://arxiv.org/abs/1901.01574

Akses Cepat

Lihat di Sumber

Informasi Jurnal

Tahun Terbit: 2019
Bahasa: en
Sumber Database: arXiv
Akses: Open Access ✓