[PDF][PDF] Systematic comparison of professional and crowdsourced reference translations for machine translation
R Zbib, G Markiewicz, S Matsoukas… - Proceedings of the …, 2013 - aclanthology.org
Proceedings of the 2013 Conference of the North American Chapter of …, 2013•aclanthology.org
We present a systematic study of the effect of crowdsourced translations on Machine
Translation performance. We compare Machine Translation systems trained on the same
data but with translations obtained using Amazon's Mechanical Turk vs. professional
translations, and show that the same performance is obtained from Mechanical Turk
translations at 1/5th the cost. We also show that adding a Mechanical Turk reference
translation of the development set improves parameter tuning and output evaluation.
Translation performance. We compare Machine Translation systems trained on the same
data but with translations obtained using Amazon's Mechanical Turk vs. professional
translations, and show that the same performance is obtained from Mechanical Turk
translations at 1/5th the cost. We also show that adding a Mechanical Turk reference
translation of the development set improves parameter tuning and output evaluation.
Abstract
We present a systematic study of the effect of crowdsourced translations on Machine Translation performance. We compare Machine Translation systems trained on the same data but with translations obtained using Amazon’s Mechanical Turk vs. professional translations, and show that the same performance is obtained from Mechanical Turk translations at 1/5th the cost. We also show that adding a Mechanical Turk reference translation of the development set improves parameter tuning and output evaluation.
aclanthology.org
以上显示的是最相近的搜索结果。 查看全部搜索结果