A survey of evaluation metrics used for NLG systems

AB Sai, AK Mohankumar, MM Khapra - ACM Computing Surveys (CSUR …, 2022 - dl.acm.org
In the last few years, a large number of automatic evaluation metrics have been proposed for
evaluating Natural Language Generation (NLG) systems. The rapid development and …

BERT: a review of applications in natural language processing and understanding

MV Koroteev - arXiv preprint arXiv:2103.11943, 2021 - arxiv.org
In this review, we describe the application of one of the most popular deep learning-based
language models-BERT. The paper describes the mechanism of operation of this model, the …

Bertscore: Evaluating text generation with bert

T Zhang, V Kishore, F Wu, KQ Weinberger… - arXiv preprint arXiv …, 2019 - arxiv.org
We propose BERTScore, an automatic evaluation metric for text generation. Analogously to
common metrics, BERTScore computes a similarity score for each token in the candidate …

Natural language processing: state of the art, current trends and challenges

D Khurana, A Koli, K Khatter, S Singh - Multimedia tools and applications, 2023 - Springer
Natural language processing (NLP) has recently gained much attention for representing and
analyzing human language computationally. It has spread its applications in various fields …

Machine translation systems and quality assessment: a systematic review

I Rivera-Trigueros - Language Resources and Evaluation, 2022 - Springer
Nowadays, in the globalised context in which we find ourselves, language barriers can still
be an obstacle to accessing information. On occasions, it is impossible to satisfy the demand …

Neural versus phrase-based machine translation quality: a case study

L Bentivogli, A Bisazza, M Cettolo… - arXiv preprint arXiv …, 2016 - arxiv.org
Within the field of Statistical Machine Translation (SMT), the neural approach (NMT) has
recently emerged as the first technology able to challenge the long-standing dominance of …

[HTML][HTML] A survey on Sign Language machine translation

A Núñez-Marcos, O Perez-de-Viñaspre… - Expert Systems with …, 2023 - Elsevier
Abstract Sign Languages (SLs) are employed by deaf and hard-of-hearing (DHH) people to
communicate on a daily basis. However, the communication with hearing people still faces …

[PDF][PDF] Findings of the 2014 workshop on statistical machine translation

O Bojar, C Buck, C Federmann, B Haddow… - Proceedings of the …, 2014 - aclanthology.org
This paper presents the results of the WMT14 shared tasks, which included a standard news
translation task, a separate medical translation task, a task for run-time estimation of …

[PDF][PDF] Minimum error rate training in statistical machine translation

FJ Och - Proceedings of the 41st annual meeting of the …, 2003 - aclanthology.org
Often, the training procedure for statistical machine translation models is based on maximum
likelihood or related criteria. A general problem of this approach is that there is only a loose …

Quality expectations of machine translation

A Way - Translation quality assessment: From principles to …, 2018 - Springer
Abstract Machine Translation (MT) is being deployed for a range of use-cases by millions of
people on a daily basis. There should, therefore, be no doubt as to the utility of MT …