Analyzing the Amazon Mechanical Turk Marketplace

Analyzing the Amazon Mechanical Turk Marketplace

| Panagiotis G. Ipeirotis
The paper "Analyzing the Amazon Mechanical Turk Marketplace" by Panagiotis G. Ipeirotis from New York University explores the dynamics and characteristics of the Amazon Mechanical Turk (AMT) marketplace, a crowdsourcing platform introduced by Amazon in 2005. The marketplace allows computers to post tasks that are typically difficult for humans to automate, such as image tagging, transcription, and content creation. The paper addresses common questions about the marketplace, including the demographics of workers, the types of tasks completed, and the cost and speed of task completion. Key findings include: - The majority of workers are from the United States, with a growing proportion from India, and they are generally younger and have lower incomes. - The marketplace is highly concentrated, with a small number of top requesters accounting for a significant portion of the activity. - Transcription tasks are the most common, followed by classification, data collection, and image tagging. - Task prices are typically low, with 90% of HITs offering less than 10 cents in reward. - The marketplace's activity follows a log-normal distribution, indicating a long tail of less active requesters. - Completion times follow a power-law distribution, suggesting unpredictability and the need for better task discovery and recommendation systems. The paper concludes by suggesting improvements to the marketplace, such as enhancing task discovery and providing better task recommendation services to improve efficiency and predictability.The paper "Analyzing the Amazon Mechanical Turk Marketplace" by Panagiotis G. Ipeirotis from New York University explores the dynamics and characteristics of the Amazon Mechanical Turk (AMT) marketplace, a crowdsourcing platform introduced by Amazon in 2005. The marketplace allows computers to post tasks that are typically difficult for humans to automate, such as image tagging, transcription, and content creation. The paper addresses common questions about the marketplace, including the demographics of workers, the types of tasks completed, and the cost and speed of task completion. Key findings include: - The majority of workers are from the United States, with a growing proportion from India, and they are generally younger and have lower incomes. - The marketplace is highly concentrated, with a small number of top requesters accounting for a significant portion of the activity. - Transcription tasks are the most common, followed by classification, data collection, and image tagging. - Task prices are typically low, with 90% of HITs offering less than 10 cents in reward. - The marketplace's activity follows a log-normal distribution, indicating a long tail of less active requesters. - Completion times follow a power-law distribution, suggesting unpredictability and the need for better task discovery and recommendation systems. The paper concludes by suggesting improvements to the marketplace, such as enhancing task discovery and providing better task recommendation services to improve efficiency and predictability.
Reach us at info@study.space