2025
Autores
Costa, L; Barbosa, S; Cunha, J;
Publicação
PROCEEDINGS OF THE 3RD ACM CONFERENCE ON REPRODUCIBILITY AND REPLICABILITY, ACM REP 2025
Abstract
Reproducibility in computational science is increasingly dependent on the ability to faithfully re-execute experiments involving code, data, and software environments. However, assessing the effectiveness of reproducibility tools is difficult due to the lack of standardized benchmarks. To address this, we collected 38 computational experiments from diverse scientific domains and attempted to reproduce each using 8 different reproducibility tools. From this initial pool, we identified 18 experiments that could be successfully reproduced using at least one tool. These experiments form our curated benchmark dataset, which we release along with reproducibility packages to support ongoing evaluation efforts. This article introduces the curated dataset, incorporating details about software dependencies, execution steps, and configurations necessary for accurate reproduction. The dataset is structured to reflect diverse computational requirements and methodologies, ranging from simple scripts to complex, multi-language workflows, ensuring it presents the wide range of challenges researchers face in reproducing computational studies. It provides a universal benchmark by establishing a standardized dataset for objectively evaluating and comparing the effectiveness of reproducibility tools. Each experiment included in the dataset is carefully documented to ensure ease of use. We added clear instructions following a standard, so each experiment has the same kind of instructions, making it easier for researchers to run each of them with their own reproducibility tool.The utility of the dataset is demonstrated through extensive evaluations using multiple reproducibility tools.
2025
Autores
Costa, L; Barbosa, S; Cunha, J;
Publicação
JOURNAL OF COMPUTER LANGUAGES
Abstract
User studies are paramount for advancing research in software engineering, particularly when evaluating tools and techniques involving programmers. However, researchers face several barriers when performing them despite the existence of supporting tools. We base our study on a set of tools and researcher-reported barriers identified in prior work on user studies in software engineering. In this work, we study how existing tools and their features cope with previously identified barriers. Moreover, we propose new features for the barriers that lack support. We validated our proposal with 102 researchers, achieving statistically significant positive support for all but one feature. We study the current gap between tools and barriers, using features as the bridge. We show there is a significant lack of support for several barriers, as some have no single tool to support them.
2025
Autores
Barbosa, S; Chambers, S; Pawlak, W; Fortuniak, K; Paatero, J; Röttger, A; Röttger, S; Chen, X; Melintescu, AM; Martin, D; Kikaj, D; Wenger, A; Stanley, K; Ramos, JB; Hatakka, J; Anttila, T; Aaltonen, H; Dias, N; Silva, ME; Castro, JA; Lappalainen, K; Azevedo, E; Kulmala, M;
Publicação
EPJ Nuclear Sciences and Technologies
Abstract
Project NuClim (Nuclear observations to improve Climate research and GHG emission estimates) aims to use high-quality measurements of atmospheric radon activity concentration and ambient radioactivity to advance climate science and improve radiation protection and nuclear surveillance capabilities. It is supported by new metrological capabilities developed in the EMPIR project 19ENV01 traceRadon. This work reviews the scientific objectives of project NuClim in terms of both climate science and radiological protection, and provides an overview of the NuClim field campaign and the various nuclear measurements being implemented within the scope of the project. © S. Barbosa et al., Published by EDP Sciences, 2025.
2025
Autores
Donner, RV; Barbosa, SM;
Publicação
Abstract
2025
Autores
Barbosa, S; Chambers, S;
Publicação
Abstract
2025
Autores
Carlos F. Gonçalves; Nuno A. Cruz; Bruno M. Ferreira; Guilherme A. Pinto; Salviano F. Soares; Vítor M. Filipe;
Publicação
OCEANS 2025 - Great Lakes
Abstract
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.