Accession Number:

ADA585850

Title:

Crowd Sourcing Data Collection through Amazon Mechanical Turk

Descriptive Note:

Final rept.

Corporate Author:

ARMY RESEARCH LAB ADELPHI MD COMPUTATIONAL AND INFORMATION SCIENCES DIRECTORATE

Personal Author(s):

Report Date:

2013-09-01

Pagination or Media Count:

38.0

Abstract:

Crowdsourcing is an increasingly popular technique used to complete complex tasks or collect large amounts of data. This report documents the effort to employ crowdsourcing using the Mechanical Turk service hosted by Amazon. The task was to collect labeling data on several thousands of short videos clips as such labels would be perceived by a human. The approach proved to be viable, collecting large amounts of data in a relatively short time frame, but required specific considerations for the population of workers and impersonal medium through which data were collected.

Subject Categories:

  • Numerical Mathematics
  • Computer Programming and Software
  • Computer Systems Management and Standards

Distribution Statement:

APPROVED FOR PUBLIC RELEASE