Abstract
Interest in artificial intelligence (AI)-driven crowd work has increased during the last few years as a line of inquiry that expands upon prior research on microtasking to represent a means of scaling up complex tasks through AI mediation. Despite the increasing attention to the macrotask phenomenon in crowdsourcing, there is a need to understand the processes, elements, and constraints underlying the infrastructural and behavioral aspects in such form of crowd work when involving collaboration. To this end, this paper provides a first attempt to characterize some of the research conducted in this direction to identify important paths for an agenda comprising key drivers, challenges, and prospects for integrating human-centered AI in collaborative crowdsourcing environments. © 2025 IEEE.

Abstract

Abstract

Abstract

Abstract

Abstract
The use of gamified crowdsourcing mechanisms through serious games and games with a purpose (GWAPs) has emerged as an effective motivational strategy for enhancing performance in human intelligence tasks (HITs). In this systematic literature review, we examine the underlying characteristics of competitive and cooperative player-oriented GWAPs and how they can be leveraged to optimize crowdsourcing performance in completing batches of HITs. By exploring gamified crowdsourcing elements in GWAPs, we can evaluate the impact of these two types of player behaviors (i.e., competition and cooperation) on motivation and performance. We reviewed 27 publications and grouped them into five categories: player orientation, game elements and motivation, crowd work optimization, gamified knowledge collection, and comparative studies and best practices. Our research pinpoints the significance of intuitive task instructions, alignment of game elements with player motivations, and the role of competitive and cooperative dynamics in enhancing engagement and performance.