Conducting clinical research using crowdsourced convenience samples
J Chandler, D Shapiro - Annual review of clinical psychology, 2016 - annualreviews.org
Crowdsourcing has had a dramatic impact on the speed and scale at which scientific
research can be conducted. Clinical scientists have particularly benefited from readily …
research can be conducted. Clinical scientists have particularly benefited from readily …
“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
N Sambasivan, S Kapania, H Highfill… - proceedings of the …, 2021 - dl.acm.org
AI models are increasingly applied in high-stakes domains like health and conservation.
Data quality carries an elevated significance in high-stakes AI due to its heightened …
Data quality carries an elevated significance in high-stakes AI due to its heightened …
Standardizing reporting of participant compensation in HCI: A systematic literature review and recommendations for the field
The user study is a fundamental method used in HCI. In designing user studies, we often
use compensation strategies to incentivize recruitment. However, compensation can also …
use compensation strategies to incentivize recruitment. However, compensation can also …
Algorithms at work: The new contested terrain of control
KC Kellogg, MA Valentine… - Academy of management …, 2020 - journals.aom.org
The widespread implementation of algorithmic technologies in organizations prompts
questions about how algorithms may reshape organizational control. We use perspective of …
questions about how algorithms may reshape organizational control. We use perspective of …
Studying up machine learning data: Why talk about bias when we mean power?
Research in machine learning (ML) has argued that models trained on incomplete or biased
datasets can lead to discriminatory outputs. In this commentary, we propose moving the …
datasets can lead to discriminatory outputs. In this commentary, we propose moving the …
A data-driven analysis of workers' earnings on Amazon Mechanical Turk
A growing number of people are working as part of on-line crowd work. Crowd work is often
thought to be low wage work. However, we know little about the wage distribution in practice …
thought to be low wage work. However, we know little about the wage distribution in practice …
Workers of the Internet unite? Online freelancer organisation among remote gig economy workers in six Asian and African countries
AJ Wood, V Lehdonvirta… - New Technology, Work …, 2018 - Wiley Online Library
This article presents findings regarding collective organisation among online freelancers in
middle‐income countries. Drawing on research in Southeast Asia and Sub‐Saharan Africa …
middle‐income countries. Drawing on research in Southeast Asia and Sub‐Saharan Africa …
Crowdworksheets: Accounting for individual and collective identities underlying crowdsourced dataset annotation
Human annotated data plays a crucial role in machine learning (ML) research and
development. However, the ethical considerations around the processes and decisions that …
development. However, the ethical considerations around the processes and decisions that …
The data-production dispositif
Machine learning (ML) depends on data to train and verify models. Very often, organizations
outsource processes related to data work (ie, generating and annotating data and …
outsource processes related to data work (ie, generating and annotating data and …
Working with machines: The impact of algorithmic and data-driven management on human workers
Software algorithms are changing how people work in an ever-growing number of fields,
managing distributed human workers at a large scale. In these work settings, human jobs …
managing distributed human workers at a large scale. In these work settings, human jobs …