Abstract

Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate is based on a sample of 114,460 completed sessions from 33,408 unique participants and 689 sessions across seven laboratories in the US, Europe, and Australia from January 2012 to March 2015.

Details

Title
The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Author
Stewart, Neil; Ungemach, Christoph; Harris, Adam J L; Bartels, Daniel M; Newell, Ben R; Paolacci, Gabriele; Chandler, Jesse
Pages
479-491
Publication year
2015
Publication date
Sep 2015
Publisher
Cambridge University Press
ISSN
19302975
Source type
Scholarly Journal
Language of publication
English
ProQuest document ID
1759527522
Copyright
Copyright Society for Judgment & Decision Making Sep 2015