As a requester on Amazon’s Mechanical Turk, I have done quite a few research projects. As a result, I was invited to speak to a college class this past semester about my experience and some of the best ways to run a survey I’ve found. Here is that presentation, in glorious portable document format:
Download and peruse at your leisure.
Here are some references I used for my literature reviews. They’re not as extensive here for the sake of brevity, but there are many more.
Here are a few annotated sources worth looking into for anyone interested in using Mturk:
Wilson, J. (2013). My gruelling day as an Amazon Mechanical Turk. Retrieved February 03, 2017, from http://kernelmag.dailydot.com/features/report/4732/my-gruelling-day-as-an-amazon-mechanical-turk/
This article details the experiences of Jeremy Wilson, a Tech reporter in The Kernel at the Daily Dot. In his 2013 experiment, he details his day working on Mturk. While some of his experiences are accurate, the way the service works in 2017 is vastly different. Gone are the Walmart receipts and face-making games. More and different HITs are posted daily. His report of the pay is a bit on the generous side. It is also apparent that he did not research the community or “tips and tricks” available (at the time) to most Workers on the platform. While not representative of a regular worker on Mturk, this article highlights the basic perception of Mturk by those whom do not use it regularly. It is worth reading for any research into Mturk, as it provides a leaping point for further review.
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2011). Using Mechanical Turk as a subject recruitment tool for experimental research. Submitted for review.
This article discusses the pros and cons of using Mturk for a research sample. It goes into detail, citing various experiments performed by the researchers. This is an excellent resource for justifying external validity through an Mturk study.
Buhrmester, M. (2016). Mechanical turk guide. WordPress. Retrieved from https://michaelbuhrmester.wordpress.com/mechanical-turk-guide/
This article details the experiences of a requester who pays a fair wage for his research. He discusses at length the best practices of a requester on Mturk. This is an essential read for anyone considering posting a survey on Mturk.