Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by HumanISE

2025

Enhancing Consumer Insights Through Multimodal Artificial Intelligence and Affective Computing

Authors
César, I; Pereira, I; Rodrigues, F; Miguéis, VL; Nicola, S; Madureira, A; Reis, JL; Dos Santos, JPM; Coelho, D; De Oliveira, DA;

Publication
IEEE ACCESS

Abstract
The growing interest in learning more about consumer behaviors through analytical techniques requires the integration of innovative approaches that relate their needs to strategic marketing procedures. Multimodality and Affective Computing combined a series of robust optimizations for this challenge, implying the complexity of each application. However, the entanglement of different modalities demands new and tailored refinements to enhance adaptability and accuracy in the field. This paper outlines the implementation of a Multimodal Artificial Intelligence methodology with Affective Computing to enhance consumer insights and marketing strategies. The application combines different data modalities, such as textual, visual, and audio inputs, to tackle complex issues in dealing with consumer sentiment. The proposed approach uses advanced preprocessing techniques, including word embeddings, neural networks, and recurrent models, to extract information from diverse modalities. Fusion strategies, such as attention-based and late fusion procedures, are utilized to combine knowledge, facilitating robust sentiment detection. The implementation includes the analysis of real-time customer feedback on social media and product assessments, demonstrating improvements in predicting engagement and shaping consumer behavior. The results underscore the practical viability of the suggested method, promoting progress in multimodal sentiment analysis to extract actionable consumer insights in marketing.

2025

Sonar-Based Deep Learning in Underwater Robotics: Overview, Robustness, and Challenges

Authors
Aubard, M; Madureira, A; Teixeira, L; Pinto, J;

Publication
IEEE JOURNAL OF OCEANIC ENGINEERING

Abstract
With the growing interest in underwater exploration and monitoring, autonomous underwater vehicles have become essential. The recent interest in onboard deep learning (DL) has advanced real-time environmental interaction capabilities relying on efficient and accurate vision-based DL models. However, the predominant use of sonar in underwater environments, characterized by limited training data and inherent noise, poses challenges to model robustness. This autonomy improvement raises safety concerns for deploying such models during underwater operations, potentially leading to hazardous situations. This article aims to provide the first comprehensive overview of sonar-based DL under the scope of robustness. It studies sonar-based DL perception task models, such as classification, object detection, segmentation, and simultaneous localization and mapping. Furthermore, this article systematizes sonar-based state-of-the-art data sets, simulators, and robustness methods, such as neural network verification, out-of-distribution, and adversarial attacks. This article highlights the lack of robustness in sonar-based DL research and suggests future research pathways, notably establishing a baseline sonar-based data set and bridging the simulation-to-reality gap.

2025

Leveraging Blockchain Integrity Mechanisms and IoT Sensors to Boost Internal Process Efficiency in Logistics Management

Authors
Cale, D; Coutinho, C; Ferreira, JC; Madureira, AM;

Publication
2025 IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED LEDGER TECHNOLOGIES, ICDLT

Abstract
Fleet logistics management requires reliable monitoring of temperature-sensitive goods and asset utilization to meet regulatory requirements and operational efficiency targets. This paper presents an integrated framework combining blockchain technology and IoT sensors to enhance internal process efficiency and data integrity in logistics operations. The research develops and deploys a permissioned blockchain system within a Portuguese logistics company, enabling empirical evaluation of core performance metrics including end-to-end latency, transaction throughput, and audit traceability under operational conditions. A pilot study involving 12 sensors distributed across transport operations demonstrates measurable improvements in audit preparation efficiency. Analysis indicates that low-latency event registration ( meaning 5 seconds) supports operational monitoring requirements, whilst automated evidence generation with cryptographic proofs reduces manual verification overhead in internal and external audit processes. The study establishes performance benchmarks and cost-benefit analysis comparing blockchain adoption against centralized logging solutions with digital signatures. The architecture enhances decision-making transparency by providing logistics managers with cryptographically verifiable operational data, whilst governance insights support organizations implementing blockchain-based integrity mechanisms in regulated environments.

2025

Introduction to the special issue on application of multi-agent systems, AI and blockchain in smart energy systems (VSI-sea)

Authors
Zamani, M; Prieta Pintado, FDl; Pinto, T;

Publication
Comput. Electr. Eng.

Abstract

2025

Integrating a spatio-temporal diffusion model with a multi-criteria decision-making approach for optimal planning of electric vehicle charging infrastructure

Authors
Mejia, MA; Macedo, LH; Pinto, T; Franco, JF;

Publication
APPLIED ENERGY

Abstract
Electric vehicles (EVs) allow a significant reduction in harmful gas emissions, thus improving urban air quality. However, the widespread adoption of this technology is limited by several factors, resulting in heterogeneous deployment in urban areas. This raises challenges regarding the planning of public electric vehicle charging infrastructure (EVCI), requiring adaptive strategies to ensure comprehensive and efficient coverage. This study introduces an innovative method that leverages geographic information systems to pinpoint appropriate sizes and suitable locations for public EVCI within urban environments. Initially, a Bass diffusion model is employed to estimate EV adoption rates by regions, enabling the determination of the appropriate sizes of EVCI necessary for each of them. Subsequently, a multi-criteria decision-making approach is applied to identify the suitable locations for EV charger installation within each region. In this way, EVCI locations are selected using spatial criteria, which ensure they are near common areas of interest and easily accessible through the road network. To validate the effectiveness and applicability of the proposed method, tests using geospatial data from a city in Brazil were carried out. The findings suggest that EVCI planning without proper spatial analysis may result in inefficient locations and inadequate sizes, which may discourage potential EV adopters and hinder widespread adoption of this technology.

2025

Explainable AI framework for reliable and transparent automated energy management in buildings

Authors
Teixeira, B; Carvalhais, L; Pinto, T; Vale, Z;

Publication
ENERGY AND BUILDINGS

Abstract
The increasing integration of Artificial Intelligence (AI) into Building Energy Management Systems (BEMS) is revolutionizing energy optimization by enabling real-time monitoring, predictive analytics, and automated control. While these advancements improve energy efficiency and sustainability, the opacity of AI models poses challenges in interpretability, limiting user trust and hindering widespread adoption in operational decisionmaking. Ensuring transparency is crucial for aligning AI insights with building performance requirements and regulatory expectations. This paper presents EI-Build, a novel Explainable Artificial Intelligence (XAI) framework designed to enhance the interpretability of intelligent automated BEMS. EI-Build integrates multiple XAI techniques, including Shapley Additive Explanations (SHAP), Local Interpretable Model-Agnostic Explanations (LIME), Anchors, Partial Dependence Plots, Feature Permutation Importance, and correlation-based statistical analysis, to provide comprehensive explanations of model behavior. By dynamically tailoring the format and depth of explanations, EI-Build ensures that insights remain accessible and actionable for different user profiles, from general occupants to energy specialists and machine learning experts. A case study on photovoltaic power generation forecasting applied to a real BEMS context evaluates EI-Build's capacity to deliver to deliver both global and local explanations, validate feature dependencies, and facilitate cross-comparison of interpretability techniques. The results highlight how EI-Build enhances user trust, facilitates informed decision-making, and improves model validation. By consolidating diverse XAI methods into a single automated framework, EI-Build represents a significant advancement in bridging the gap between complex AI energy models and real-world applications.

  • 54
  • 739