Automatic machine translation evaluation in many languages via zero-shot paraphrasing

B Thompson, M Post - arXiv preprint arXiv:2004.14564, 2020 - arxiv.org
We frame the task of machine translation evaluation as one of scoring machine translation
output with a sequence-to-sequence paraphraser, conditioned on a human reference. We …

Unsupervised quality estimation for neural machine translation

M Fomicheva, S Sun, L Yankovskaya… - Transactions of the …, 2020 - direct.mit.edu
Quality Estimation (QE) is an important component in making Machine Translation (MT)
useful in real-world applications, as it is aimed to inform the user on the quality of the MT …

TransQuest: Translation quality estimation with cross-lingual transformers

T Ranasinghe, C Orasan, R Mitkov - arXiv preprint arXiv:2011.01536, 2020 - arxiv.org
Recent years have seen big advances in the field of sentence-level quality estimation (QE),
largely as a result of using neural-based architectures. However, the majority of these …

OpenKiwi: An open source framework for quality estimation

F Kepler, J Trénous, M Treviso, M Vera… - arXiv preprint arXiv …, 2019 - arxiv.org
We introduce OpenKiwi, a PyTorch-based open source framework for translation quality
estimation. OpenKiwi supports training and testing of word-level and sentence-level quality …

Findings of the WMT 2021 shared task on quality estimation

L Specia, F Blain, M Fomicheva, C Zerva… - Proceedings of the …, 2021 - aclanthology.org
We report the results of the WMT 2021 shared task on Quality Estimation, where the
challenge is to predict the quality of the output of neural machine translation systems at the …

Improving back-translation with uncertainty-based confidence estimation

S Wang, Y Liu, C Wang, H Luan, M Sun - arXiv preprint arXiv:1909.00157, 2019 - arxiv.org
While back-translation is simple and effective in exploiting abundant monolingual corpora to
improve low-resource neural machine translation (NMT), the synthetic bilingual corpora …

From Handcrafted Features to LLMs: A Brief Survey for Machine Translation Quality Estimation

H Zhao, Y Liu, S Tao, W Meng, Y Chen, X Geng… - arXiv preprint arXiv …, 2024 - arxiv.org
Machine Translation Quality Estimation (MTQE) is the task of estimating the quality of
machine-translated text in real time without the need for reference translations, which is of …

An exploratory analysis of multilingual word-level quality estimation with cross-lingual transformers

T Ranasinghe, C Orasan, R Mitkov - arXiv preprint arXiv:2106.00143, 2021 - arxiv.org
Most studies on word-level Quality Estimation (QE) of machine translation focus on
language-specific models. The obvious disadvantages of these approaches are the need for …

BERGAMOT-LATTE submissions for the WMT20 quality estimation shared task

M Fomicheva, S Sun, L Yankovskaya, F Blain… - 2020 - wlv.openrepository.com
This paper presents our submission to the WMT2020 Shared Task on Quality Estimation
(QE). We participate in Task and Task 2 focusing on sentence-level prediction. We explore …

Quality estimation and translation metrics via pre-trained word and sentence embeddings

E Yankovskaya, A Tättar, M Fishel - … 3: Shared Task Papers, Day 2 …, 2019 - aclanthology.org
We propose the use of pre-trained embeddings as features of a regression model for
sentence-level quality estimation of machine translation. In our work we combine freely …