Adequacy–fluency metrics: Evaluating mt in the continuous space model framework

RE Banchs, LF D'Haro, H Li - IEEE/ACM Transactions on Audio …, 2015 - ieeexplore.ieee.org
This work extends and evaluates a two-dimensional automatic evaluation metric for machine
translation, which is designed to operate at the sentence level. The metric is based on the …

The link between translation difficulty and the quality of machine translation: a literature review and empirical investigation

S Araghi, A Palangkaraya - Language Resources and Evaluation, 2024 - Springer
We survey the relevant literature on translation difficulty and automatic evaluation of
machine translation (MT) quality and investigate whether source text's translation difficulty …

Cross-generational linguistic variation in the Canberra Vietnamese heritage language community: A corpus-centred investigation

L Nguyen - 2021 - repository.cam.ac.uk
This dissertation investigates cross-generational linguistic differences in the Canberra
Vietnamese bilingual community, with a particular focus on Vietnamese as the heritage …

VERTa: a linguistic approach to automatic machine translation evaluation

E Comelles, J Atserias - Language Resources and Evaluation, 2019 - Springer
Abstract Machine translation (MT) is directly linked to its evaluation in order to both compare
different MT system outputs and analyse system errors so that they can be addressed and …

[PDF][PDF] XMEANT: Better semantic MT evaluation without reference translations

C Lo, M Beloucif, M Saers, D Wu - … of the 52nd Annual Meeting of …, 2014 - aclanthology.org
We introduce XMEANT—a new cross-lingual version of the semantic frame based MT
evaluation metric MEANT—which can correlate even more closely with human adequacy …

[PDF][PDF] Red: A reference dependency based mt evaluation metric

H Yu, X Wu, J Xie, W Jiang, Q Liu… - Proceedings of COLING …, 2014 - aclanthology.org
Most of the widely-used automatic evaluation metrics consider only the local fragments of
the references and translations, and they ignore the evaluation on the syntax level. Current …

Otem&Utem: Over-and under-translation evaluation metric for NMT

J Yang, B Zhang, Y Qin, X Zhang, Q Lin… - … Language Processing and …, 2018 - Springer
Although neural machine translation (NMT) yields promising translation performance, it
unfortunately suffers from over-and under-translation issues [31], of which studies have …

CanVEC-the canberra Vietnamese-English code-switching natural speech corpus

L Nguyen, C Bryant - … of the Twelfth Language Resources and …, 2020 - aclanthology.org
This paper introduces the Canberra Vietnamese-English Code-switching corpus (CanVEC),
an original corpus of natural mixed speech that we semi-automatically annotated with …

Improving machine translation into Chinese by tuning against Chinese MEANT

C Lo, M Beloucif, D Wu - … of the 10th International Workshop on …, 2013 - aclanthology.org
We present the first ever results showing that Chinese MT output is significantly improved by
tuning a MT system against a semantic frame based objective function, MEANT, rather than …

Machine translation evaluation metric based on dependency parsing model

H Yu, W Xu, S Lin, Q Liu - ACM Transactions on Asian and Low …, 2019 - dl.acm.org
Most of the syntax-based metrics obtain the similarity by comparing the sub-structures
extracted from the trees of hypothesis and reference. These sub-structures cannot represent …