Association for Computing Machinery (ACM)
CHI ‘21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
Targeting the right group of workers for crowdsourcing often achieves better quality results. One unique example of targeted crowdsourcing is seeking community-situated workers whose familiarity with the background and the norms of a particular group can help produce better outcome or accuracy. These community-situated crowd workers can be recruited in different ways from generic online crowdsourcing platforms or from online recovery communities. We evaluate three different approaches to recruit generic and community-situated crowd in terms of the time and the cost of recruitment, and the accuracy of task completion. We consider the context of Alcoholics Anonymous (AA), the largest peer support group for recovering alcoholics, and the task of identifying and validating AA meeting information. We discuss the benefits and trade-offs of recruiting paid vs. unpaid community-situated workers and provide implications for future research in the recovery context and relevant domains of HCI, and for the design of crowdsourcing ICT systems.
Rubya, Sabirat; Numainville, Joseph; and Yarosh, Svetlana, "Needles in a Haystack: How Pooling Can Control Error Rates in Noisy Tests" (2021). Computer Science Faculty Research and Publications. 67.