Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

2025

CompRep: A Dataset For Computational Reproducibility

Authors
Costa, L; Barbosa, S; Cunha, J;

Publication
PROCEEDINGS OF THE 3RD ACM CONFERENCE ON REPRODUCIBILITY AND REPLICABILITY, ACM REP 2025

Abstract
Reproducibility in computational science is increasingly dependent on the ability to faithfully re-execute experiments involving code, data, and software environments. However, assessing the effectiveness of reproducibility tools is difficult due to the lack of standardized benchmarks. To address this, we collected 38 computational experiments from diverse scientific domains and attempted to reproduce each using 8 different reproducibility tools. From this initial pool, we identified 18 experiments that could be successfully reproduced using at least one tool. These experiments form our curated benchmark dataset, which we release along with reproducibility packages to support ongoing evaluation efforts. This article introduces the curated dataset, incorporating details about software dependencies, execution steps, and configurations necessary for accurate reproduction. The dataset is structured to reflect diverse computational requirements and methodologies, ranging from simple scripts to complex, multi-language workflows, ensuring it presents the wide range of challenges researchers face in reproducing computational studies. It provides a universal benchmark by establishing a standardized dataset for objectively evaluating and comparing the effectiveness of reproducibility tools. Each experiment included in the dataset is carefully documented to ensure ease of use. We added clear instructions following a standard, so each experiment has the same kind of instructions, making it easier for researchers to run each of them with their own reproducibility tool.The utility of the dataset is demonstrated through extensive evaluations using multiple reproducibility tools.

2025

MutDafny: A Mutation-Based Approach to Assess Dafny Specifications

Authors
Amaral, I; Mendes, A; Campos, J;

Publication
CoRR

Abstract

2025

Resilient Agent-Based Networks in the Automotive Industry

Authors
, A; Rocha, C; Campos, P;

Publication
Machine Learning Perspectives of Agent-Based Models

Abstract
The present work is inspired by the aftermarket companies of the automotive industry. The goal is to investigate how companies react to market change, by understanding the effect of a perturbation (such as a business cessation) on the rest of the companies that are interconnected through peer-to-peer relationships. An agent-based model has been developed that simulates a multilayer network involving different types of companies: suppliers, aftermarket companies; retailers and consumers. The effect of the cessation is measured by the resilience of the multilayer network after suffering the perturbation. The multilayer network is inspired in a business model of the automobile industry’s aftermarket and each type of company has some defined characteristics. The agent-based model produces the network dynamics due to the changes in its configuration throughout time. No learning mechanism is introduced in this work. We demonstrate that the number of links, the volume of sales and the total profit of a node in the network has an impact on its survival throughout time. © 2025 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG.

2025

Mind the gap: The missing features of the tools to support user studies in software engineering

Authors
Costa, L; Barbosa, S; Cunha, J;

Publication
JOURNAL OF COMPUTER LANGUAGES

Abstract
User studies are paramount for advancing research in software engineering, particularly when evaluating tools and techniques involving programmers. However, researchers face several barriers when performing them despite the existence of supporting tools. We base our study on a set of tools and researcher-reported barriers identified in prior work on user studies in software engineering. In this work, we study how existing tools and their features cope with previously identified barriers. Moreover, we propose new features for the barriers that lack support. We validated our proposal with 102 researchers, achieving statistically significant positive support for all but one feature. We study the current gap between tools and barriers, using features as the bridge. We show there is a significant lack of support for several barriers, as some have no single tool to support them.

2025

Budget-Constrained Collaborative Renewable Energy Forecasting Market

Authors
Gonçalves, C; Bessa, RJ; Teixeira, T; Vinagre, J;

Publication
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY

Abstract
Accurate power forecasting from renewable energy sources (RES) is crucial for integrating additional RES capacity into the power system and realizing sustainability goals. This work emphasizes the importance of integrating decentralized spatio-temporal data into forecasting models. However, decentralized data ownership presents a critical obstacle to the success of such spatio-temporal models, and incentive mechanisms to foster data-sharing need to be considered. The main contributions are a) a comparative analysis of the forecasting models, advocating for efficient and interpretable spline LASSO regression models, and b) a bidding mechanism within the data/analytics market to ensure fair compensation for data providers and enable both buyers and sellers to express their data price requirements. Furthermore, an incentive mechanism for time series forecasting is proposed, effectively incorporating price constraints and preventing redundant feature allocation. Results show significant accuracy improvements and potential monetary gains for data sellers. For wind power data, an average root mean squared error improvement of over 10% was achieved by comparing forecasts generated by the proposal with locally generated ones.

2025

Inferring multiple helper Dafny assertions with LLMs

Authors
Silva, AF; Mendes, A; Martins, R;

Publication
CoRR

Abstract

  • 273
  • 4496