A survey of deep learning techniques for neural machine translation

S Yang, Y Wang, X Chu - arXiv preprint arXiv:2002.07526, 2020 - arxiv.org
In recent years, natural language processing (NLP) has got great development with deep
learning techniques. In the sub-field of machine translation, a new approach named Neural …

On the linguistic representational power of neural machine translation models

Y Belinkov, N Durrani, F Dalvi, H Sajjad… - Computational …, 2020 - direct.mit.edu
Despite the recent success of deep neural networks in natural language processing and
other spheres of artificial intelligence, their interpretability remains a challenge. We analyze …

Transfer learning for low-resource neural machine translation

B Zoph, D Yuret, J May, K Knight - arXiv preprint arXiv:1604.02201, 2016 - arxiv.org
The encoder-decoder framework for neural machine translation (NMT) has been shown
effective in large data scenarios, but is much less effective for low-resource languages. We …

Learning to write with cooperative discriminators

A Holtzman, J Buys, M Forbes, A Bosselut… - arXiv preprint arXiv …, 2018 - arxiv.org
Recurrent Neural Networks (RNNs) are powerful autoregressive sequence models, but
when used to generate natural language their output tends to be overly generic, repetitive …

[PDF][PDF] Fast and robust neural network joint models for statistical machine translation

J Devlin, R Zbib, Z Huang, T Lamar… - proceedings of the …, 2014 - aclanthology.org
Recent work has shown success in using neural network language models (NNLMs) as
features in MT systems. Here, we present a novel formulation for a neural network joint …

On the impact of various types of noise on neural machine translation

H Khayrallah, P Koehn - arXiv preprint arXiv:1805.12282, 2018 - arxiv.org
We examine how various types of noise in the parallel training data impact the quality of
neural machine translation systems. We create five types of artificial noise and analyze how …

[PDF][PDF] Batch tuning strategies for statistical machine translation

C Cherry, G Foster - Proceedings of the 2012 conference of the …, 2012 - aclanthology.org
There has been a proliferation of recent work on SMT tuning algorithms capable of handling
larger feature sets than the traditional MERT approach. We analyze a number of these …

[PDF][PDF] Tuning as ranking

M Hopkins, J May - Proceedings of the 2011 Conference on …, 2011 - aclanthology.org
We offer a simple, effective, and scalable method for statistical machine translation
parameter tuning based on the pairwise approach to ranking (Herbrich et al., 1999). Unlike …

Deep RNNs encode soft hierarchical syntax

T Blevins, O Levy, L Zettlemoyer - arXiv preprint arXiv:1805.04218, 2018 - arxiv.org
We present a set of experiments to demonstrate that deep recurrent neural networks (RNNs)
learn internal representations that capture soft hierarchical notions of syntax from highly …

[PDF][PDF] Machine translation of Arabic dialects

R Zbib, E Malchiodi, J Devlin, D Stallard… - Proceedings of the …, 2012 - aclanthology.org
Arabic Dialects present many challenges for machine translation, not least of which is the
lack of data resources. We use crowdsourcing to cheaply and quickly build Levantine …