Conducting clinical research using crowdsourced convenience samples

J Chandler, D Shapiro - Annual review of clinical psychology, 2016 - annualreviews.org
Crowdsourcing has had a dramatic impact on the speed and scale at which scientific
research can be conducted. Clinical scientists have particularly benefited from readily …

“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI

N Sambasivan, S Kapania, H Highfill… - proceedings of the …, 2021 - dl.acm.org
AI models are increasingly applied in high-stakes domains like health and conservation.
Data quality carries an elevated significance in high-stakes AI due to its heightened …

Standardizing reporting of participant compensation in HCI: A systematic literature review and recommendations for the field

J Pater, A Coupe, R Pfafman, C Phelan… - Proceedings of the …, 2021 - dl.acm.org
The user study is a fundamental method used in HCI. In designing user studies, we often
use compensation strategies to incentivize recruitment. However, compensation can also …

Algorithms at work: The new contested terrain of control

KC Kellogg, MA Valentine… - Academy of management …, 2020 - journals.aom.org
The widespread implementation of algorithmic technologies in organizations prompts
questions about how algorithms may reshape organizational control. We use perspective of …

Studying up machine learning data: Why talk about bias when we mean power?

M Miceli, J Posada, T Yang - Proceedings of the ACM on Human …, 2022 - dl.acm.org
Research in machine learning (ML) has argued that models trained on incomplete or biased
datasets can lead to discriminatory outputs. In this commentary, we propose moving the …

A data-driven analysis of workers' earnings on Amazon Mechanical Turk

K Hara, A Adams, K Milland, S Savage… - Proceedings of the …, 2018 - dl.acm.org
A growing number of people are working as part of on-line crowd work. Crowd work is often
thought to be low wage work. However, we know little about the wage distribution in practice …

Workers of the Internet unite? Online freelancer organisation among remote gig economy workers in six Asian and African countries

AJ Wood, V Lehdonvirta… - New Technology, Work …, 2018 - Wiley Online Library
This article presents findings regarding collective organisation among online freelancers in
middle‐income countries. Drawing on research in Southeast Asia and Sub‐Saharan Africa …

Crowdworksheets: Accounting for individual and collective identities underlying crowdsourced dataset annotation

M Díaz, I Kivlichan, R Rosen, D Baker… - Proceedings of the …, 2022 - dl.acm.org
Human annotated data plays a crucial role in machine learning (ML) research and
development. However, the ethical considerations around the processes and decisions that …

The data-production dispositif

M Miceli, J Posada - Proceedings of the ACM on human-computer …, 2022 - dl.acm.org
Machine learning (ML) depends on data to train and verify models. Very often, organizations
outsource processes related to data work (ie, generating and annotating data and …

Working with machines: The impact of algorithmic and data-driven management on human workers

MK Lee, D Kusbit, E Metsky, L Dabbish - Proceedings of the 33rd annual …, 2015 - dl.acm.org
Software algorithms are changing how people work in an ever-growing number of fields,
managing distributed human workers at a large scale. In these work settings, human jobs …