In the last few years, a large number of automatic evaluation metrics have been proposed for
evaluating Natural Language Generation (NLG) systems. The rapid development and …

To facilitate effective translation modeling and translation studies, one of the crucial
questions to address is how to assess translation quality. From the perspectives of accuracy …

There is considerable interest in the task of automatically generating image captions.
However, evaluation is challenging. Existing automatic evaluation metrics are primarily …

Current measures for evaluating text simplification systems focus on evaluating lexical text
aspects, neglecting its structural aspects. In this paper we propose the first measure to …

We present experiments in using discourse structure for improving machine translation
evaluation. We first design two discourse-aware similarity measures, which use all-subtree …

Existing metrics to evaluate the quality of Machine Translation hypotheses take different
perspectives into account. DPM-Fcomb, a metric combining the merits of a range of metrics …

We present a framework for machine translation evaluation using neural networks in a
pairwise setting, where the goal is to select the better translation from a pair of hypotheses …

We present a novel framework for machine translation evaluation using neural networks in a
pairwise setting, where the goal is to select the better translation from a pair of hypotheses …

We introduce the Machine Translation (MT) evaluation survey that contains both manual and
automatic evaluation methods. The traditional human evaluation criteria mainly include the …

In this article, we explore the potential of using sentence-level discourse structure for
machine translation evaluation. We first design discourse-aware similarity measures, which …