Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

2025

Enhancing Consumer Insights Through Multimodal Artificial Intelligence and Affective Computing

Autores
César, I; Pereira, I; Rodrigues, F; Miguéis, VL; Nicola, S; Madureira, A; Reis, JL; Dos Santos, JPM; Coelho, D; De Oliveira, DA;

Publicação
IEEE ACCESS

Abstract
The growing interest in learning more about consumer behaviors through analytical techniques requires the integration of innovative approaches that relate their needs to strategic marketing procedures. Multimodality and Affective Computing combined a series of robust optimizations for this challenge, implying the complexity of each application. However, the entanglement of different modalities demands new and tailored refinements to enhance adaptability and accuracy in the field. This paper outlines the implementation of a Multimodal Artificial Intelligence methodology with Affective Computing to enhance consumer insights and marketing strategies. The application combines different data modalities, such as textual, visual, and audio inputs, to tackle complex issues in dealing with consumer sentiment. The proposed approach uses advanced preprocessing techniques, including word embeddings, neural networks, and recurrent models, to extract information from diverse modalities. Fusion strategies, such as attention-based and late fusion procedures, are utilized to combine knowledge, facilitating robust sentiment detection. The implementation includes the analysis of real-time customer feedback on social media and product assessments, demonstrating improvements in predicting engagement and shaping consumer behavior. The results underscore the practical viability of the suggested method, promoting progress in multimodal sentiment analysis to extract actionable consumer insights in marketing.

2025

Stress-Testing of Multimodal Models in Medical Image-Based Report Generation

Autores
Carvalhido, F; Cardoso, HL; Cerqueira, V;

Publicação
THIRTY-NINTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, AAAI-25, VOL 39 NO 28

Abstract
Multimodal models, namely vision-language models, present unique possibilities through the seamless integration of different information mediums for data generation. These models mostly act as a black-box, making them lack transparency and explicability. Reliable results require accountable and trustworthy Artificial Intelligence (AI), namely when in use for critical tasks, such as the automatic generation of medical imaging reports for healthcare diagnosis. By exploring stresstesting techniques, multimodal generative models can become more transparent by disclosing their shortcomings, further supporting their responsible usage in the medical field.

2025

Decision-making systems improvement based on explainable artificial intelligence approaches for predictive maintenance

Autores
Rajaoarisoa, L; Randrianandraina, R; Nalepa, GJ; Gama, J;

Publicação
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE

Abstract
To maintain the performance of the latest generation of onshore and offshore wind turbine systems, a new methodology must be proposed to enhance the maintenance policy. In this context, this paper introduces an approach to designing a decision support tool that combines predictive capabilities with anomaly explanations for effective IoT predictive maintenance tasks. Essentially, the paper proposes an approach that integrates a predictive maintenance model with an explicative decision-making system. The key challenge is to detect anomalies and provide plausible explanations, enabling human operators to determine the necessary actions swiftly. To achieve this, the proposed approach identifies a minimal set of relevant features required to generate rules that explain the root causes of issues in the physical system. It estimates that certain features, such as the active power generator, blade pitch angle, and the average water temperature of the voltage circuit protection in the generator's sub-components, are particularly critical to monitor. Additionally, the approach simplifies the computation of an efficient predictive maintenance model. Compared to other deep learning models, the identified model provides up to 80% accuracy in anomaly detection and up to 96% for predicting the remaining useful life of the system under study. These performance metrics and indicators values are essential for enhancing the decision-making process. Moreover, the proposed decision support tool elucidates the onset of degradation and its dynamic evolution based on expert knowledge and data gathered through Internet of Things (IoT) technology and inspection reports. Thus, the developed approach should aid maintenance managers in making accurate decisions regarding inspection, replacement, and repair tasks. The methodology is demonstrated using a wind farm dataset provided by Energias De Portugal.

2025

Environmental sustainability balanced scorecard: a strategic map for joint action by municipalities

Autores
Santos, ASS; Moreira, MRA; Sousa, PSA;

Publicação
SUSTAINABILITY ACCOUNTING MANAGEMENT AND POLICY JOURNAL

Abstract
PurposeThis study seeks to develop an Environmental Sustainability Balanced Scorecard (ESBSC) articulated through a strategic map for collaborative implementation by municipalities by municipalities. In addition, it aims to elucidate the architecture of this tool.Design/methodology/approachThe research uses qualitative methodology, initiating with document analysis, followed by municipal-level surveys and an interview with the Norte Portugal Regional Coordination and Development Commission (CCDR-N).FindingsThe study constructs an ESBSC that adopts an integrative approach to sustainability, focusing on municipal joint action. The tool fosters synergies and enhances cooperation. By incorporating a strategic mix, the tool contributes to improving the environmental management performance of the participating municipalities.Practical implicationsThis study introduces a tool designed for municipalities that aspire to incorporate environmental sustainability into their strategies. This tool facilitates the implementation and management of a long-term environmental strategy, with potential implications for organization and its culture. In addition, it highlights critical environmental factors that should serve as a starting point in future studies or applications of this tool.Social implicationsInvolving both an academic institution and multiple municipalities, this research identifies critical environmental factors that enhance environmental awareness within municipalities and designs a tool that, when consciously adopted, can influence the culture dynamics of the population involved. Furthermore, it proposes a structured and systematic research method for creating an ESBSC for joint municipal action.Originality/valueTo the best of authors' knowledge, this research constitutes the first exploratory attempt to devise an environmental strategy for joint municipal action. Although the tool emphasizes the environmental component, it promotes an integrated vision of sustainability. Despite the extensive application of balanced scorecards in various organizational contexts, their utilization in fostering environmental sustainability at a municipal level remains underexplored. This study addresses this gap by developing a tailored strategic tool that operationalizes environmental priorities within municipal governance frameworks.

2025

Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2025 - Volume 1: GRAPP, HUCAPP and IVAPP, Porto, Portugal, February 26-28, 2025

Autores
Rogers, TB; Meneveaux, D; Ammi, M; Ziat, M; Jänicke, S; Purchase, HC; Radeva, P; Furnari, A; Bouatouch, K; de Sousa, AA;

Publicação
VISIGRAPP (1): GRAPP, HUCAPP, IVAPP

Abstract

2025

Advanced driving assistance integration in electric motorcycles: road surface classification with a focus on gravel detection using deep learning

Autores
Venancio, R; Filipe, V; Cerveira, A; Gonçalves, L;

Publicação
FRONTIERS IN ARTIFICIAL INTELLIGENCE

Abstract
Riding a motorcycle involves risks that can be minimized through advanced sensing and response systems to assist the rider. The use of camera-collected images to monitor road conditions can aid in the development of tools designed to enhance rider safety and prevent accidents. This paper proposes a method for developing deep learning models designed to operate efficiently on embedded systems like the Raspberry Pi, facilitating real-time decisions that consider the road condition. Our research tests and compares several state-of-the-art convolutional neural network architectures, including EfficientNet and Inception, to determine which offers the best balance between inference time and accuracy. Specifically, we measured top-1 accuracy and inference time on a Raspberry Pi, identifying EfficientNetV2 as the most suitable model due to its optimal trade-off between performance and computational demand. The model's top-1 accuracy significantly outperformed other models while maintaining competitive inference speeds, making it ideal for real-time applications in traffic-dense urban settings.

  • 135
  • 4387