arXiv Open Access 2021

A Review of Human Evaluation for Style Transfer

Eleftheria Briakou Sweta Agrawal Ke Zhang Joel Tetreault Marine Carpuat

Lihat Sumber

Abstrak

This paper reviews and summarizes human evaluation practices described in 97 style transfer papers with respect to three main evaluation aspects: style transfer, meaning preservation, and fluency. In principle, evaluations by human raters should be the most reliable. However, in style transfer papers, we find that protocols for human evaluations are often underspecified and not standardized, which hampers the reproducibility of research in this field and progress toward better human and automatic evaluation methods.

Topik & Kata Kunci

cs.CL

Penulis (5)

Eleftheria Briakou

Sweta Agrawal

Ke Zhang

Joel Tetreault

Marine Carpuat

Format Sitasi

APA MLA BibTeX

Briakou, E., Agrawal, S., Zhang, K., Tetreault, J., Carpuat, M. (2021). A Review of Human Evaluation for Style Transfer. https://arxiv.org/abs/2106.04747

Akses Cepat

Lihat di Sumber

Informasi Jurnal

Tahun Terbit: 2021
Bahasa: en
Sumber Database: arXiv
Akses: Open Access ✓