MRQA 2019 shared task: Evaluating generalization in reading comprehension

A Fisch, A Talmor, R Jia, M Seo, E Choi… - arXiv preprint arXiv …, 2019 - arxiv.org
We present the results of the Machine Reading for Question Answering (MRQA) 2019
shared task on evaluating the generalization capabilities of reading comprehension …

MOCHA: A dataset for training and evaluating generative reading comprehension metrics

A Chen, G Stanovsky, S Singh, M Gardner - arXiv preprint arXiv …, 2020 - arxiv.org
Posing reading comprehension as a generation problem provides a great deal of flexibility,
allowing for open-ended questions with few restrictions on possible answers. However …

Generalizing question answering system with pre-trained language model fine-tuning

D Su, Y Xu, GI Winata, P Xu, H Kim, Z Liu… - Proceedings of the …, 2019 - aclanthology.org
With a large number of datasets being released and new techniques being proposed,
Question answering (QA) systems have witnessed great breakthroughs in reading …

DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs

D Dua, Y Wang, P Dasigi, G Stanovsky, S Singh… - arXiv preprint arXiv …, 2019 - arxiv.org
Reading comprehension has recently seen rapid progress, with systems matching humans
on the most popular datasets for the task. However, a large body of work has highlighted the …

A multi-type multi-span network for reading comprehension that requires discrete reasoning

M Hu, Y Peng, Z Huang, D Li - arXiv preprint arXiv:1908.05514, 2019 - arxiv.org
Rapid progress has been made in the field of reading comprehension and question
answering, where several systems have achieved human parity in some simplified settings …

R4C: A benchmark for evaluating RC systems to get the right answer for the right reason

N Inoue, P Stenetorp, K Inui - arXiv preprint arXiv:1910.04601, 2019 - arxiv.org
Recent studies have revealed that reading comprehension (RC) systems learn to exploit
annotation artifacts and other biases in current datasets. This prevents the community from …

Learning to ask unanswerable questions for machine reading comprehension

H Zhu, L Dong, F Wei, W Wang, B Qin, T Liu - arXiv preprint arXiv …, 2019 - arxiv.org
Machine reading comprehension with unanswerable questions is a challenging task. In this
work, we propose a data augmentation technique by automatically generating relevant …

Improving machine reading comprehension with general reading strategies

K Sun, D Yu, D Yu, C Cardie - arXiv preprint arXiv:1810.13441, 2018 - arxiv.org
Reading strategies have been shown to improve comprehension levels, especially for
readers lacking adequate prior knowledge. Just as the process of knowledge accumulation …

MultiQA: An empirical investigation of generalization and transfer in reading comprehension

A Talmor, J Berant - arXiv preprint arXiv:1905.13453, 2019 - arxiv.org
A large number of reading comprehension (RC) datasets has been created recently, but little
analysis has been done on whether they generalize to one another, and the extent to which …

Qanet: Combining local convolution with global self-attention for reading comprehension

AW Yu, D Dohan, MT Luong, R Zhao, K Chen… - arXiv preprint arXiv …, 2018 - arxiv.org
Current end-to-end machine reading and question answering (Q\&A) models are primarily
based on recurrent neural networks (RNNs) with attention. Despite their success, these …