A survey of the usages of deep learning for natural language processing

DW Otter, JR Medina, JK Kalita - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Over the last several years, the field of natural language processing has been propelled
forward by an explosion in the use of deep learning models. This article provides a brief …

Globally normalized transition-based neural networks

D Andor, C Alberti, D Weiss, A Severyn… - arXiv preprint arXiv …, 2016 - arxiv.org
We introduce a globally normalized transition-based neural network model that achieves
state-of-the-art part-of-speech tagging, dependency parsing and sentence compression …

[PDF][PDF] Grammar as a Foreign Language

O Vinyals - arXiv preprint arXiv:1412.7449, 2015 - keji.us.kg
Syntactic constituency parsing is a fundamental problem in naturallanguage processing
which has been the subject of intensive researchand engineering for decades. As a result …

[PDF][PDF] Syntactic annotations for the google books ngram corpus

Y Lin, JB Michel, EA Lieberman, J Orwant… - Proceedings of the …, 2012 - aclanthology.org
We present a new edition of the Google Books Ngram Corpus, which describes how often
words and phrases were used over a period of five centuries, in eight languages; it reflects …

Learning dependency-based compositional semantics

P Liang, MI Jordan, D Klein - Computational Linguistics, 2013 - direct.mit.edu
Suppose we want to build a system that answers a natural language question by
representing its semantics as a logical forxm and computing the answer given a structured …

Structured training for neural network transition-based parsing

D Weiss, C Alberti, M Collins, S Petrov - arXiv preprint arXiv:1506.06158, 2015 - arxiv.org
We present structured perceptron training for neural network transition-based dependency
parsing. We learn the neural network representation using a gold corpus augmented by a …

Square one bias in NLP: Towards a multi-dimensional exploration of the research manifold

S Ruder, I Vulić, A Søgaard - arXiv preprint arXiv:2206.09755, 2022 - arxiv.org
The prototypical NLP experiment trains a standard architecture on labeled English data and
optimizes for accuracy, without accounting for other dimensions such as fairness …

From symbolic to sub-symbolic information in question classification

J Silva, L Coheur, AC Mendes, A Wichert - Artificial Intelligence Review, 2011 - Springer
Question Answering (QA) is undoubtedly a growing field of current research in Artificial
Intelligence. Question classification, a QA subtask, aims to associate a category to each …

Extending a parser to distant domains using a few dozen partially annotated examples

V Joshi, M Peters, M Hopkins - arXiv preprint arXiv:1805.06556, 2018 - arxiv.org
We revisit domain adaptation for parsers in the neural era. First we show that recent
advances in word representations greatly diminish the need for domain adaptation when the …

Dependency-based convolutional neural networks for sentence embedding

M Ma, L Huang, B Xiang, B Zhou - arXiv preprint arXiv:1507.01839, 2015 - arxiv.org
In sentence modeling and classification, convolutional neural network approaches have
recently achieved state-of-the-art results, but all such efforts process word vectors …