We survey the relevant literature on translation difficulty and automatic evaluation of
machine translation (MT) quality and investigate whether source text's translation difficulty …

Assessing the quality of candidate translations involves diverse linguistic facets. However,
most automatic evaluation methods in use today rely on limited quality assumptions, such as …

Abstract Machine translation (MT) is directly linked to its evaluation in order to both compare
different MT system outputs and analyse system errors so that they can be addressed and …

Treebanks are valuable linguistic resources that include the syntactic structure of a
language sentence in addition to part-of-speech tags and morphological features. They are …

We introduce XMEANT—a new cross-lingual version of the semantic frame based MT
evaluation metric MEANT—which can correlate even more closely with human adequacy …

We propose a novel metric ATEC for automatic MT evaluation based on explicit assessment
of word choice and word order in an MT output in comparison to its reference translation (s) …

In this paper we show how labelled dependencies produced by a Lexical-Functional
Grammar parser can be used in Machine Translation evaluation. In contrast to most popular …

Most of the widely-used automatic evaluation metrics consider only the local fragments of
the references and translations, and they ignore the evaluation on the syntax level. Current …

Using a Grammar Checker for Evaluation and Postprocessing of Statistical Machine
Translation Page 1 Using a Grammar Checker for Evaluation and Postprocessing of …

This paper describes a novel approach to syntactically-informed evaluation of machine
translation (MT). Using a statistical, treebanktrained parser, we extract word-word …