Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por HumanISE

2026

Comparing LLM and expert assessments of journal quality

Autores
Saarela, M; Pölönen, J; Linna, AK; Wahlfors, L; Correia, A; Kärkkäinen, T;

Publicação
Scientometrics

Abstract
Abstract Some performance-based research funding systems rely on expert-assigned journal rankings to allocate resources and guide research evaluation. In Finland, the JuFo system provides journal rankings, determined by experts who assess journals using available metadata, such as bibliometric indicators, alongside qualitative judgment. While prior work has explored machine learning approaches to approximate these rankings, the recent emergence of large language models (LLMs) offers new possibilities for automated, data-driven evaluation. In this study, we examine how well LLMs can replicate JuFo rankings when given the same structured information available to experts, including citation metrics, disciplinary assignments, and publisher metadata. We systematically compare LLM predictions to expert-assigned JuFo ranks using a confusion-matrix analysis to identify cases of alignment and deviation. Our research addresses two key questions: (1) how accurately LLMs estimate journal rankings, and (2) in which situations their predictions diverge from expert judgments and which factors explain these discrepancies. Our findings show that LLMs approximate expert-assigned rankings with high overall accuracy, with most errors occurring between adjacent levels. However, their performance varies systematically across disciplines, and they tend to under-predict top-tier journals, particularly in social sciences and humanities fields.

2026

From the Margin to the Centre: Ethnomethodology as a Tool for Situating Cultural Insensitivities in AI Through the Lens of Music-Making

Autores
António Correia; Hesam Mohseni; Pieta-Anniina Sikström; Tommi Kärkkäinen;

Publicação
2026 International Conference on Artificial Intelligence, Computer, Data Sciences and Applications (ACDSA)

Abstract

2026

Nudging Away from Online Extremism: A Review of Digital Nudges as Tools for Polarization De-Escalation

Autores
Neves, WAP; Dias, A; Correia, A; Schneider, D;

Publicação
ICEIS (2)

Abstract

2026

Interactive In-App Guidance for Healthcare Software Onboarding: A Systematic Review and Mixed-Methods Survey (Preprint)

Autores
Lopes, V; S. Mamede, H; Santos, A;

Publicação

Abstract
BACKGROUND

Healthcare organizations increasingly rely on complex digital systems, but software onboarding often depends on manuals and classroom-based training that do not fit well with fast-paced clinical workflows. Interactive in-app guidance may better support learning during real work, although healthcare-specific evidence is still limited.

OBJECTIVE

To synthesize evidence on effective onboarding mechanisms for healthcare software and to explore how interactive in-app guidance compares with traditional onboarding in terms of perceived learning support, cognitive burden, and adoption-related outcomes.

METHODS

The study used a sequential design with two components: (1) a systematic literature review following Kitchenham’s procedures; and (2) a mixed-methods survey administered via Qualtrics to healthcare professionals (n = 44), complemented by a small screened subsample of IT professionals with healthcare DAP implementation experience (n = 5). Quantitative data were analysed descriptively, and qualitative responses were examined through thematic analysis to explain and contextualize the observed patterns.

RESULTS

The findings from both the literature review and the survey showed a consistent pattern: workflow-embedded onboarding approaches, including hands-on practice, stepwise contextual guidance, and searchable in-app support, were perceived to reduce learning friction and cognitive effort while improving confidence. Among healthcare respondents, 61% reported greater willingness to use the software after onboarding. Continued use was mainly associated with remembering how to use features, interface usability, workflow efficiency, and perceived impact on patient care. IT respondents highlighted implementation constraints related to integration, analytics, and compliance, but also perceived reductions in support burden.

CONCLUSIONS

Interactive, context-sensitive onboarding appears to be a practical strategy to support healthcare software adoption, especially because it aligns learning with real workflows. The findings support the use of workflow-embedded guidance to improve usability in context and user confidence during onboarding, while also indicating the need for stronger healthcare-specific, outcome-based evaluations of DAP-enabled approaches.

2026

Infragenie: Living Software Architecture Diagrams From Docker Compose Files

Autores
Ferreira, R; Correia, FF; Queiroz, PGG;

Publicação
SOFTWARE ARCHITECTURE. ECSA 2025 TRACKS AND WORKSHOPS

Abstract
Software architecture is reflected across multiple artifacts, making it difficult to communicate without proper documentation, which often becomes outdated or unreliable. We propose an approach to support Living Documentation by generating architectural diagrams from Docker Compose files. We implement our approach as a prototype tool that we name Infragenie and conduct an empirical study to show the viability of the approach. The study involved sending questionnaires to maintainers of 378 GitHub repositories. We received 36 responses. Infragenie-generated diagrams were rated as better or much better for most of the 12 projects with previous diagrams. Over 70% of the respondents agreed that our approach improved documentation completeness, consistency, and accessibility, and more than 90% recognized its effectiveness in capturing key architectural elements. We conclude that by using Docker Compose files we were able to provide useful architectural diagrams.

2026

Refactoring Towards Microservices: Preparing the Ground for Service Extraction

Autores
Peixoto, R; Correia, FF; Rosa, T; Guerra, E; Goldman, A;

Publicação
PATTERN LANGUAGES OF PROGRAMS, PEOPLE AND PRACTICES, EUROPLOP 2025, PT I

Abstract
As organizations increasingly transition from monolithic systems to microservices, they aim to achieve higher availability, automatic scaling, simplified infrastructure management, enhanced collaboration, and streamlined deployments. However, this migration process remains largely manual and labour-intensive. While existing literature offers various strategies for decomposing monoliths, these approaches primarily focus on architecture-level guidance, often overlooking the code-level challenges and dependencies that developers must address during the migration. This article introduces a catalogue of seven refactorings specifically designed to support the transition to a microservices architecture with a focus on handling dependencies. The catalogue provides developers with a systematic guide that consolidates refactorings identified in the literature and addresses the critical gap in systematizing the process at the code level. By offering a structured, step-by-step approach, this work simplifies the migration process and lays the groundwork for its potential automation, empowering developers to implement these changes efficiently and effectively.

  • 14
  • 740