DOAJ Open Access 2021

What do post-editors correct? A fine-grained analysis of SMT and NMT errors

Sergi Alvarez-Vidal Antoni Oliver Toni Badia

Abstrak

The recent improvements in neural MT (NMT) have driven a shift from statistical MT (SMT) to NMT. However, to assess the usefulness of MT models for post-editing (PE) and have a detailed insight of the output they produce, we need to analyse the most frequent errors and how they affect the task. We present a pilot study of a fine-grained analysis of MT errors based on post-editors corrections for an English to Spanish medical text translated with SMT and NMT. We use the MQM taxonomy to compare the two MT models and have a categorized classification of the errors produced. Even though results show a great variation among post-editors’ corrections, for this language combination fewer errors are corrected by post-editors in the NMT output. NMT also produces fewer accuracy errors and errors that are less critical.

Penulis (3)

S

Sergi Alvarez-Vidal

A

Antoni Oliver

T

Toni Badia

Format Sitasi

Alvarez-Vidal, S., Oliver, A., Badia, T. (2021). What do post-editors correct? A fine-grained analysis of SMT and NMT errors. https://doi.org/10.5565/rev/tradumatica.286

Akses Cepat

PDF tidak tersedia langsung

Cek di sumber asli →
Lihat di Sumber doi.org/10.5565/rev/tradumatica.286
Informasi Jurnal
Tahun Terbit
2021
Sumber Database
DOAJ
DOI
10.5565/rev/tradumatica.286
Akses
Open Access ✓