Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by HumanISE

2023

BEYOND FRONT AND BACK OFFICE: VISUALIZATIONS, REPRESENTATIONS AND ACCESS THROUGH POSTCOLONIAL LENSES BETWEEN A RESEARCH PLATFORM AND AN ARTS EDUCATION ARCHIVE

Authors
Assis, T; Martins, C; Valle, A; Santos, A; Castro, J; Osório, L; Silva, P;

Publication
ICERI2023 Proceedings - ICERI Proceedings

Abstract

2023

A Comparison of Point Set Registration Algorithms for Quantification of Change in Spatiotemporal Data

Authors
Gomes M.; De Carvalho A.V.; Oliveira M.A.; Carneiro E.;

Publication
Iberian Conference on Information Systems and Technologies, CISTI

Abstract
Point Set Registration (PSR) algorithms have very different underlying theoretical models to define a process that calculates the alignment solution between two point clouds. The selection of a particular PSR algorithm can be based on the efficiency (time to compute the alignment) and accuracy (a measure of error using the estimated alignment). In our specific context, previous work used a CPD algorithm to detect and quantify change in spatiotemporal datasets composed of moving and shape-changing objects represented by a sequence of time stamped 2D polygon boundaries. Though the results were promising, we question if the selection of a particular PSR algorithm influences the results of detection and quantification of change. In this work we review and compare several PSR algorithms, characterize test datasets and used metrics, and perform tests for the selected datasets. The results show pyCPD and cyCPD implementations of CPD to be good alternatives and that BCPD can have potential to be yet another alternative. The results also show that detection and quantification accuracy change for some of the tested PSR implementations.

2023

A Model for Cognitive Personalization of Microtask Design

Authors
Paulino, D; Guimaraes, D; Correia, A; Ribeiro, J; Barroso, J; Paredes, H;

Publication
SENSORS

Abstract
The study of data quality in crowdsourcing campaigns is currently a prominent research topic, given the diverse range of participants involved. A potential solution to enhancing data quality processes in crowdsourcing is cognitive personalization, which involves appropriately adapting or assigning tasks based on a crowd worker's cognitive profile. There are two common methods for assessing a crowd worker's cognitive profile: administering online cognitive tests, and inferring behavior from task fingerprinting based on user interaction log events. This article presents the findings of a study that investigated the complementarity of both approaches in a microtask scenario, focusing on personalizing task design. The study involved 134 unique crowd workers recruited from a crowdsourcing marketplace. The main objective was to examine how the administration of cognitive ability tests can be used to allocate crowd workers to microtasks with varying levels of difficulty, including the development of a deep learning model. Another goal was to investigate if task fingerprinting can be used to allocate crowd workers to different microtasks in a personalized manner. The results indicated that both objectives were accomplished, validating the usage of cognitive tests and task fingerprinting as effective mechanisms for microtask personalization, including the development of a deep learning model with 95% accuracy in predicting the accuracy of the microtasks. While we achieved an accuracy of 95%, it is important to note that the small dataset size may have limited the model's performance.

2023

Designing for Hybrid Intelligence: A Taxonomy and Survey of Crowd-Machine Interaction

Authors
Correia, A; Grover, A; Schneider, D; Pimentel, AP; Chaves, R; de Almeida, MA; Fonseca, B;

Publication
APPLIED SCIENCES-BASEL

Abstract
With the widespread availability and pervasiveness of artificial intelligence (AI) in many application areas across the globe, the role of crowdsourcing has seen an upsurge in terms of importance for scaling up data-driven algorithms in rapid cycles through a relatively low-cost distributed workforce or even on a volunteer basis. However, there is a lack of systematic and empirical examination of the interplay among the processes and activities combining crowd-machine hybrid interaction. To uncover the enduring aspects characterizing the human-centered AI design space when involving ensembles of crowds and algorithms and their symbiotic relations and requirements, a Computer-Supported Cooperative Work (CSCW) lens strongly rooted in the taxonomic tradition of conceptual scheme development is taken with the aim of aggregating and characterizing some of the main component entities in the burgeoning domain of hybrid crowd-AI centered systems. The goal of this article is thus to propose a theoretically grounded and empirically validated analytical framework for the study of crowd-machine interaction and its environment. Based on a scoping review and several cross-sectional analyses of research studies comprising hybrid forms of human interaction with AI systems and applications at a crowd scale, the available literature was distilled and incorporated into a unifying framework comprised of taxonomic units distributed across integration dimensions that range from the original time and space axes in which every collaborative activity take place to the main attributes that constitute a hybrid intelligence architecture. The upshot is that when turning to the challenges that are inherent in tasks requiring massive participation, novel properties can be obtained for a set of potential scenarios that go beyond the single experience of a human interacting with the technology to comprise a vast set of massive machine-crowd interactions.

2023

A hybrid human-AI tool for scientometric analysis

Authors
Correia, A; Grover, A; Jameel, S; Schneider, D; Antunes, P; Fonseca, B;

Publication
ARTIFICIAL INTELLIGENCE REVIEW

Abstract
Solid research depends on systematic, verifiable and repeatable scientometric analysis. However, scientometric analysis is difficult in the current research landscape characterized by the increasing number of publications per year, intersections between research domains, and the diversity of stakeholders involved in research projects. To address this problem, we propose SciCrowd, a hybrid human-AI mixed-initiative system, which supports the collaboration between Artificial Intelligence services and crowdsourcing services. This work discusses the design and evaluation of SciCrowd. The evaluation is focused on attitudes, concerns and intentions towards use. This study contributes a nuanced understanding of the interplay between algorithmic and human tasks in the process of conducting scientometric analysis.

2023

Investigating Author Research Relatedness through Crowdsourcing: A Replication Study on MTurk

Authors
Correia, A; Paulino, D; Paredes, H; Guimarães, D; Schneider, D; Fonseca, B;

Publication
26th International Conference on Computer Supported Cooperative Work in Design, CSCWD 2023, Rio de Janeiro, Brazil, May 24-26, 2023

Abstract

  • 58
  • 658