The link between translation difficulty and the quality of machine translation: a literature review and empirical investigation
S Araghi, A Palangkaraya - Language Resources and Evaluation, 2024 - Springer
We survey the relevant literature on translation difficulty and automatic evaluation of
machine translation (MT) quality and investigate whether source text's translation difficulty …
machine translation (MT) quality and investigate whether source text's translation difficulty …
Linguistic measures for automatic machine translation evaluation
Assessing the quality of candidate translations involves diverse linguistic facets. However,
most automatic evaluation methods in use today rely on limited quality assumptions, such as …
most automatic evaluation methods in use today rely on limited quality assumptions, such as …
VERTa: a linguistic approach to automatic machine translation evaluation
E Comelles, J Atserias - Language Resources and Evaluation, 2019 - Springer
Abstract Machine translation (MT) is directly linked to its evaluation in order to both compare
different MT system outputs and analyse system errors so that they can be addressed and …
different MT system outputs and analyse system errors so that they can be addressed and …
I3rab: A new Arabic dependency treebank based on Arabic grammatical theory
Treebanks are valuable linguistic resources that include the syntactic structure of a
language sentence in addition to part-of-speech tags and morphological features. They are …
language sentence in addition to part-of-speech tags and morphological features. They are …
[PDF][PDF] XMEANT: Better semantic MT evaluation without reference translations
We introduce XMEANT—a new cross-lingual version of the semantic frame based MT
evaluation metric MEANT—which can correlate even more closely with human adequacy …
evaluation metric MEANT—which can correlate even more closely with human adequacy …
ATEC: automatic evaluation of machine translation via word choice and word order
We propose a novel metric ATEC for automatic MT evaluation based on explicit assessment
of word choice and word order in an MT output in comparison to its reference translation (s) …
of word choice and word order in an MT output in comparison to its reference translation (s) …
Evaluating machine translation with LFG dependencies
K Owczarzak, J van Genabith, A Way - Machine Translation, 2007 - Springer
In this paper we show how labelled dependencies produced by a Lexical-Functional
Grammar parser can be used in Machine Translation evaluation. In contrast to most popular …
Grammar parser can be used in Machine Translation evaluation. In contrast to most popular …
[PDF][PDF] Red: A reference dependency based mt evaluation metric
Most of the widely-used automatic evaluation metrics consider only the local fragments of
the references and translations, and they ignore the evaluation on the syntax level. Current …
the references and translations, and they ignore the evaluation on the syntax level. Current …
[PDF][PDF] Using a Grammar Checker for Evaluation and Postprocessing of Statistical Machine Translation.
S Stymne, L Ahrenberg - LREC, 2010 - lrec-conf.org
Using a Grammar Checker for Evaluation and Postprocessing of Statistical Machine
Translation Page 1 Using a Grammar Checker for Evaluation and Postprocessing of …
Translation Page 1 Using a Grammar Checker for Evaluation and Postprocessing of …
[PDF][PDF] BLEUATRE: Flattening syntactic dependencies for MT evaluation
DN Mehay, C Brew - Proceedings of the 11th Conference on …, 2007 - aclanthology.org
This paper describes a novel approach to syntactically-informed evaluation of machine
translation (MT). Using a statistical, treebanktrained parser, we extract word-word …
translation (MT). Using a statistical, treebanktrained parser, we extract word-word …