A survey of human-in-the-loop for machine learning

X Wu, L Xiao, Y Sun, J Zhang, T Ma, L He - Future Generation Computer …, 2022 - Elsevier
Abstract Machine learning has become the state-of-the-art technique for many tasks
including computer vision, natural language processing, speech processing tasks, etc …

Break It Down: A Question Understanding Benchmark

T Wolfson, M Geva, A Gupta, M Gardner… - Transactions of the …, 2020 - direct.mit.edu
Understanding natural language questions entails the ability to break down a question into
the requisite steps for computing its answer. In this work, we introduce a Question …

Putting humans in the natural language processing loop: A survey

ZJ Wang, D Choi, S Xu, D Yang - arXiv preprint arXiv:2103.04044, 2021 - arxiv.org
How can we design Natural Language Processing (NLP) systems that learn from human
feedback? There is a growing research body of Human-in-the-loop (HITL) NLP frameworks …

Large-scale QA-SRL parsing

N FitzGerald, J Michael, L He, L Zettlemoyer - arXiv preprint arXiv …, 2018 - arxiv.org
We present a new large-scale corpus of Question-Answer driven Semantic Role Labeling
(QA-SRL) annotations, and the first high-quality QA-SRL parser. Our corpus, QA-SRL Bank …

Speak to your parser: Interactive text-to-SQL with natural language feedback

A Elgohary, S Hosseini, AH Awadallah - arXiv preprint arXiv:2005.02539, 2020 - arxiv.org
We study the task of semantic parse correction with natural language feedback. Given a
natural language utterance, most semantic parsing systems pose the problem as one-shot …

From zero to hero: Human-in-the-loop entity linking in low resource domains

JC Klie, RE De Castilho, I Gurevych - Proceedings of the 58th …, 2020 - aclanthology.org
Entity linking (EL) is concerned with disambiguating entity mentions in a text against
knowledge bases (KB). It is crucial in a considerable number of fields like humanities …

Crowdsourcing question-answer meaning representations

J Michael, G Stanovsky, L He, I Dagan… - arXiv preprint arXiv …, 2017 - arxiv.org
We introduce Question-Answer Meaning Representations (QAMRs), which represent the
predicate-argument structure of a sentence as a set of question-answer pairs. We also …

Model-based interactive semantic parsing: A unified framework and a text-to-SQL case study

Z Yao, Y Su, H Sun, W Yih - arXiv preprint arXiv:1910.05389, 2019 - arxiv.org
As a promising paradigm, interactive semantic parsing has shown to improve both semantic
parsing accuracy and user confidence in the results. In this paper, we propose a new …

An imitation game for learning semantic parsers from user interaction

Z Yao, Y Tang, W Yih, H Sun, Y Su - arXiv preprint arXiv:2005.00689, 2020 - arxiv.org
Despite the widely successful applications, bootstrapping and fine-tuning semantic parsers
are still a tedious process with challenges such as costly data annotation and privacy risks …

Interactive semantic parsing for if-then recipes via hierarchical reinforcement learning

Z Yao, X Li, J Gao, B Sadler, H Sun - … of the AAAI Conference on Artificial …, 2019 - aaai.org
Given a text description, most existing semantic parsers synthesize a program in one shot.
However, it is quite challenging to produce a correct program solely based on the …