An MTurk crisis? Shifts in data quality and the impact on study results
M Chmielewski, SC Kucker - Social Psychological and …, 2020 - journals.sagepub.com
Amazon's Mechanical Turk (MTurk) is arguably one of the most important research tools of
the past decade. The ability to rapidly collect large amounts of high-quality human subjects …
the past decade. The ability to rapidly collect large amounts of high-quality human subjects …
Conducting behavioral research on Amazon's Mechanical Turk
Abstract Amazon's Mechanical Turk is an online labor market where requesters post jobs
and workers choose which jobs to do for pay. The central purpose of this article is to …
and workers choose which jobs to do for pay. The central purpose of this article is to …
[HTML][HTML] Serial dependence in the perception of attractiveness
The perception of attractiveness is essential for choices of food, object, and mate preference.
Like perception of other visual features, perception of attractiveness is stable despite …
Like perception of other visual features, perception of attractiveness is stable despite …
Using crowdsourcing for TREC relevance assessment
Crowdsourcing has recently gained a lot of attention as a tool for conducting different kinds
of relevance evaluations. At a very high level, crowdsourcing describes outsourcing of tasks …
of relevance evaluations. At a very high level, crowdsourcing describes outsourcing of tasks …
Damaged goods: Perception of pornography addiction as a mediator between religiosity and relationship anxiety surrounding pornography use
ND Leonhardt, BJ Willoughby… - The Journal of Sex …, 2018 - Taylor & Francis
Recent research on pornography suggests that perception of addiction predicts negative
outcomes above and beyond pornography use. Research has also suggested that religious …
outcomes above and beyond pornography use. Research has also suggested that religious …
Crowdsourcing for search evaluation
The Crowdsourcing for Search Evaluation Workshop (CSE 2010) was held on July 23, 2010
in Geneva, Switzerland, in conjunction with the 33rd Annual ACM SIGIR Conference. The …
in Geneva, Switzerland, in conjunction with the 33rd Annual ACM SIGIR Conference. The …
Using CrowdFlower to study the relationship between self-reported violations and traffic accidents
Crowdsourcing is a promising approach for Human Factors survey research. We explored
the use of a relatively new crowdsourcing platform called CrowdFlower. Our survey focused …
the use of a relatively new crowdsourcing platform called CrowdFlower. Our survey focused …
Creation of reliable relevance judgments in information retrieval systems evaluation experimentation through crowdsourcing: a review
Test collection is used to evaluate the information retrieval systems in laboratory‐based
evaluation experimentation. In a classic setting, generating relevance judgments involves …
evaluation experimentation. In a classic setting, generating relevance judgments involves …
Beyond AMT: An analysis of crowd work platforms
D Vakharia, M Lease - arXiv preprint arXiv:1310.1672, 2013 - arxiv.org
While Amazon's Mechanical Turk (AMT) helped launch the paid crowd work industry eight
years ago, many new vendors now offer a range of alternative models. Despite this, little …
years ago, many new vendors now offer a range of alternative models. Despite this, little …
Sustainable beer: testing the effects of water conservation messages and brewery type on consumer perceptions
Beer brewing is a water intensive industry, which has led breweries to adopt different water
conservation practices such as buying water offsets or using reclaimed water. In order to …
conservation practices such as buying water offsets or using reclaimed water. In order to …