Grammatical error correction: A survey of the state of the art

C Bryant, Z Yuan, MR Qorib, H Cao, HT Ng… - Computational …, 2023 - direct.mit.edu
Abstract Grammatical Error Correction (GEC) is the task of automatically detecting and
correcting errors in text. The task not only includes the correction of grammatical errors, such …

Findings of the 2019 conference on machine translation (WMT19)

L Barrault, O Bojar, MR Costa-Jussa, C Federmann… - 2019 - zora.uzh.ch
This paper presents the results of the premier shared task organized alongside the
Conference on Machine Translation (WMT) 2019. Participants were asked to build machine …

Translation quality assessment: A brief survey on manual and automatic methods

L Han, GJF Jones, AF Smeaton - arXiv preprint arXiv:2105.03311, 2021 - arxiv.org
To facilitate effective translation modeling and translation studies, one of the crucial
questions to address is how to assess translation quality. From the perspectives of accuracy …

Results of the WMT21 metrics shared task: Evaluating metrics with expert-based human evaluations on TED and news domain

M Freitag, R Rei, N Mathur, C Lo… - Proceedings of the …, 2021 - aclanthology.org
This paper presents the results of the WMT21 Metrics Shared Task. Participants were asked
to score the outputs of the translation systems competing in the WMT21 News Translation …

Findings of the 2021 conference on machine translation (WMT21)

A Farhad, A Arkady, B Magdalena, B Ondřej… - Proceedings of the …, 2021 - cris.fbk.eu
This paper presents the results of the news translation task, the multilingual low-resource
translation for Indo-European languages, the triangular translation task, and the automatic …

Quality-aware decoding for neural machine translation

P Fernandes, A Farinhas, R Rei, JGC de Souza… - arXiv preprint arXiv …, 2022 - arxiv.org
Despite the progress in machine translation quality estimation and evaluation in the last
years, decoding in neural machine translation (NMT) is mostly oblivious to this and centers …

UniTE: Unified translation evaluation

Y Wan, D Liu, B Yang, H Zhang, B Chen… - arXiv preprint arXiv …, 2022 - arxiv.org
Translation quality evaluation plays a crucial role in machine translation. According to the
input format, it is mainly separated into three tasks, ie, reference-only, source-only and …

TransQuest: Translation quality estimation with cross-lingual transformers

T Ranasinghe, C Orasan, R Mitkov - arXiv preprint arXiv:2011.01536, 2020 - arxiv.org
Recent years have seen big advances in the field of sentence-level quality estimation (QE),
largely as a result of using neural-based architectures. However, the majority of these …

Findings of the WMT 2021 shared task on quality estimation

L Specia, F Blain, M Fomicheva, C Zerva… - Proceedings of the …, 2021 - aclanthology.org
We report the results of the WMT 2021 shared task on Quality Estimation, where the
challenge is to predict the quality of the output of neural machine translation systems at the …

The eval4nlp 2023 shared task on prompting large language models as explainable metrics

C Leiter, J Opitz, D Deutsch, Y Gao, R Dror… - arXiv preprint arXiv …, 2023 - arxiv.org
With an increasing number of parameters and pre-training data, generative large language
models (LLMs) have shown remarkable capabilities to solve tasks with minimal or no task …