Neural machine translation: A review

F Stahlberg - Journal of Artificial Intelligence Research, 2020 - jair.org
The field of machine translation (MT), the automatic translation of written text from one
natural language into another, has experienced a major paradigm shift in recent years …

[HTML][HTML] Progress in neural NLP: modeling, learning, and reasoning

M Zhou, N Duan, S Liu, HY Shum - Engineering, 2020 - Elsevier
Natural language processing (NLP) is a subfield of artificial intelligence that focuses on
enabling computers to understand and process human languages. In the last five years, we …

[HTML][HTML] Bridging the gap: A survey on integrating (human) feedback for natural language generation

P Fernandes, A Madaan, E Liu, A Farinhas… - Transactions of the …, 2023 - direct.mit.edu
Natural language generation has witnessed significant advancements due to the training of
large language models on vast internet-scale datasets. Despite these advancements, there …

SimCLS: A simple framework for contrastive learning of abstractive summarization

Y Liu, P Liu - arXiv preprint arXiv:2106.01890, 2021 - arxiv.org
In this paper, we present a conceptually simple while empirically powerful framework for
abstractive summarization, SimCLS, which can bridge the gap between the learning …

Quark: Controllable text generation with reinforced unlearning

X Lu, S Welleck, J Hessel, L Jiang… - Advances in neural …, 2022 - proceedings.neurips.cc
Large-scale language models often learn behaviors that are misaligned with user
expectations. Generated text may contain offensive or toxic language, contain significant …

Neural text generation with unlikelihood training

S Welleck, I Kulikov, S Roller, E Dinan, K Cho… - arXiv preprint arXiv …, 2019 - arxiv.org
Neural text generation is a key tool in natural language applications, but it is well known
there are major problems at its core. In particular, standard likelihood training and decoding …

Survey of low-resource machine translation

B Haddow, R Bawden, AVM Barone, J Helcl… - Computational …, 2022 - direct.mit.edu
We present a survey covering the state of the art in low-resource machine translation (MT)
research. There are currently around 7,000 languages spoken in the world and almost all …

[HTML][HTML] A scenario-generic neural machine translation data augmentation method

X Liu, J He, M Liu, Z Yin, L Yin, W Zheng - Electronics, 2023 - mdpi.com
Amid the rapid advancement of neural machine translation, the challenge of data sparsity
has been a major obstacle. To address this issue, this study proposes a general data …

Ranking sentences for extractive summarization with reinforcement learning

S Narayan, SB Cohen, M Lapata - arXiv preprint arXiv:1802.08636, 2018 - arxiv.org
Single document summarization is the task of producing a shorter version of a document
while preserving its principal information content. In this paper we conceptualize extractive …

Findings of the 2017 conference on machine translation (wmt17)

O Bojar, R Chatterjee, C Federmann, Y Graham… - 2017 - doras.dcu.ie
This paper presents the results of the WMT17 shared tasks, which included three machine
translation (MT) tasks (news, biomedical, and multimodal), two evaluation tasks (metrics and …