Machine learning with crowdsourcing: A brief summary of the past research and future directions

VS Sheng, J Zhang - Proceedings of the AAAI conference on artificial …, 2019 - ojs.aaai.org
With crowdsourcing systems, labels can be obtained with low cost, which facilitates the
creation of training sets for prediction model learning. However, the labels obtained from …

Knowledge learning with crowdsourcing: A brief review and systematic perspective

J Zhang - IEEE/CAA Journal of Automatica Sinica, 2022 - ieeexplore.ieee.org
Big data have the characteristics of enormous volume, high velocity, diversity, value-sparsity,
and uncertainty, which lead the knowledge learning from them full of challenges. With the …

Active learning query strategies for classification, regression, and clustering: A survey

P Kumar, A Gupta - Journal of Computer Science and Technology, 2020 - Springer
Generally, data is available abundantly in unlabeled form, and its annotation requires some
cost. The labeling, as well as learning cost, can be minimized by learning with the minimum …

Active learning: A survey

CC Aggarwal, X Kong, Q Gu, J Han, SY Philip - Data classification, 2014 - taylorfrancis.com
In all these cases, labels can be obtained, but only at a significant cost to the end user. An
important observation is that all records are not equally important from the perspective of …

Learning from crowdsourced labeled data: a survey

J Zhang, X Wu, VS Sheng - Artificial Intelligence Review, 2016 - Springer
With the rapid growing of crowdsourcing systems, quite a few applications based on a
supervised learning paradigm can easily obtain massive labeled data at a relatively low …

Active learning enabled activity recognition

HMS Hossain, MAAH Khan, N Roy - Pervasive and Mobile Computing, 2017 - Elsevier
Activity recognition in smart environment has been investigated rigorously in recent years.
Researchers are enhancing the underlying activity discovery and recognition process by …

Active learning from weak and strong labelers

C Zhang, K Chaudhuri - Advances in Neural Information …, 2015 - proceedings.neurips.cc
An active learner is given a hypothesis class, a large set of unlabeled examples and the
ability to interactively query labels to an oracle of a subset of these examples; the goal of the …

A review and experimental analysis of active learning over crowdsourced data

B Sayin, E Krivosheev, J Yang, A Passerini… - Artificial Intelligence …, 2021 - Springer
Training data creation is increasingly a key bottleneck for developing machine learning,
especially for deep learning systems. Active learning provides a cost-effective means for …

A survey on cost types, interaction schemes, and annotator performance models in selection algorithms for active learning in classification

M Herde, D Huseljic, B Sick, A Calma - IEEE Access, 2021 - ieeexplore.ieee.org
Pool-based active learning (AL) aims to optimize the annotation process (ie, labeling) as the
acquisition of annotations is often time-consuming and therefore expensive. For this …

Active learning for crowdsourcing using knowledge transfer

M Fang, J Yin, D Tao - Proceedings of the AAAI conference on artificial …, 2014 - ojs.aaai.org
This paper studies the active learning problem in crowdsourcing settings, where multiple
imperfect annotators with varying levels of expertise are available for labeling the data in a …