Findings of the WMT 2021 shared task on quality estimation
We report the results of the WMT 2021 shared task on Quality Estimation, where the
challenge is to predict the quality of the output of neural machine translation systems at the …
challenge is to predict the quality of the output of neural machine translation systems at the …
SentSim: Crosslingual semantic evaluation of machine translation
Abstract Machine translation (MT) is currently evaluated in one of two ways: in a
monolingual fashion, by comparison with the system output to one or more human reference …
monolingual fashion, by comparison with the system output to one or more human reference …
Global explainability of BERT-based evaluation metrics by disentangling along linguistic factors
Evaluation metrics are a key ingredient for progress of text generation systems. In recent
years, several BERT-based evaluation metrics have been proposed (including BERTScore …
years, several BERT-based evaluation metrics have been proposed (including BERTScore …
An exploratory analysis of multilingual word-level quality estimation with cross-lingual transformers
Most studies on word-level Quality Estimation (QE) of machine translation focus on
language-specific models. The obvious disadvantages of these approaches are the need for …
language-specific models. The obvious disadvantages of these approaches are the need for …
HW-TSC's participation at WMT 2021 quality estimation shared task
This paper presents our work in WMT 2021 Quality Estimation (QE) Shared Task. We
participated in all of the three sub-tasks, including Sentence-Level Direct Assessment (DA) …
participated in all of the three sub-tasks, including Sentence-Level Direct Assessment (DA) …
Language-agnostic representation from multilingual sentence encoders for cross-lingual similarity estimation
N Tiyajamorn, T Kajiwara, Y Arase… - Proceedings of the 2021 …, 2021 - aclanthology.org
We propose a method to distill a language-agnostic meaning embedding from a multilingual
sentence encoder. By removing language-specific information from the original embedding …
sentence encoder. By removing language-specific information from the original embedding …
Comparative analysis of current approaches to quality estimation for neural machine translation
Quality estimation (QE) has recently gained increasing interest as it can predict the quality of
machine translation results without a reference translation. QE is an annual shared task at …
machine translation results without a reference translation. QE is an annual shared task at …
Error identification for machine translation with metric embedding and attention
Abstract Quality Estimation (QE) for Machine Translation has been shown to reach relatively
high accuracy in predicting sentence-level scores, relying on pretrained contextual …
high accuracy in predicting sentence-level scores, relying on pretrained contextual …
Measuring Uncertainty in Neural Machine Translation with Similarity-Sensitive Entropy
J Cheng, A Vlachos - Proceedings of the 18th Conference of the …, 2024 - aclanthology.org
Uncertainty estimation is an important diagnostic tool for statistical models, and is often used
to assess the confidence of model predictions. Previous work shows that neural machine …
to assess the confidence of model predictions. Previous work shows that neural machine …
Quality estimation using dual encoders with transfer learning
This paper describes POSTECH's quality estimation systems submitted to Task 2 of the WMT
2021 quality estimation shared task: Word and Sentence-Level Post-editing Effort. We notice …
2021 quality estimation shared task: Word and Sentence-Level Post-editing Effort. We notice …