Multi-task learning in natural language processing: An overview

S Chen, Y Zhang, Q Yang - ACM Computing Surveys, 2024 - dl.acm.org
Deep learning approaches have achieved great success in the field of Natural Language
Processing (NLP). However, directly training deep neural models often suffer from overfitting …

Interpreting deep learning models in natural language processing: A review

X Sun, D Yang, X Li, T Zhang, Y Meng, H Qiu… - arXiv preprint arXiv …, 2021 - arxiv.org
Neural network models have achieved state-of-the-art performances in a wide range of
natural language processing (NLP) tasks. However, a long-standing criticism against neural …

Learning to retrieve reasoning paths over wikipedia graph for question answering

A Asai, K Hashimoto, H Hajishirzi, R Socher… - arXiv preprint arXiv …, 2019 - arxiv.org
Answering questions that require multi-hop reasoning at web-scale necessitates retrieving
multiple evidence documents, one of which often has little lexical or semantic relationship to …

Unifiedqa: Crossing format boundaries with a single qa system

D Khashabi, S Min, T Khot, A Sabharwal… - arXiv preprint arXiv …, 2020 - arxiv.org
Question answering (QA) tasks have been posed using a variety of formats, such as
extractive span selection, multiple choice, etc. This has led to format-specialized models …

Cogltx: Applying bert to long texts

M Ding, C Zhou, H Yang, J Tang - Advances in Neural …, 2020 - proceedings.neurips.cc
BERTs are incapable of processing long texts due to its quadratically increasing memory
and time consumption. The straightforward thoughts to address this problem, such as slicing …

Hierarchical graph network for multi-hop question answering

Y Fang, S Sun, Z Gan, R Pillai, S Wang… - arXiv preprint arXiv …, 2019 - arxiv.org
In this paper, we present Hierarchical Graph Network (HGN) for multi-hop question
answering. To aggregate clues from scattered texts across multiple paragraphs, a …

Select, answer and explain: Interpretable multi-hop reading comprehension over multiple documents

M Tu, K Huang, G Wang, J Huang, X He… - Proceedings of the AAAI …, 2020 - ojs.aaai.org
Interpretable multi-hop reading comprehension (RC) over multiple documents is a
challenging problem because it demands reasoning over multiple information sources and …

Mner-qg: An end-to-end mrc framework for multimodal named entity recognition with query grounding

M Jia, L Shen, X Shen, L Liao, M Chen, X He… - Proceedings of the …, 2023 - ojs.aaai.org
Multimodal named entity recognition (MNER) is a critical step in information extraction,
which aims to detect entity spans and classify them to corresponding entity types given a …

Transformer-xh: Multi-evidence reasoning with extra hop attention

C Zhao, C Xiong, C Rosset, X Song… - International …, 2020 - openreview.net
Transformers have achieved new heights modeling natural language as a sequence of text
tokens. However, in many real world scenarios, textual data inherently exhibits structures …

A survey on machine reading comprehension systems

R Baradaran, R Ghiasi, H Amirkhani - Natural Language Engineering, 2022 - cambridge.org
Machine Reading Comprehension (MRC) is a challenging task and hot topic in Natural
Language Processing. The goal of this field is to develop systems for answering the …