Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por Ivo Pereira

2025

Exploring multimodal learning applications in marketing: A critical perspective

Autores
César, I; Pereira, I; Rodrigues, F; Miguéis, VL; Nicola, S; Madureira, A;

Publicação
Int. J. Hybrid Intell. Syst.

Abstract
This review discusses the integration of intelligent technologies into customer interactions in organizations and highlights the benefits of using artificial intelligence systems based on a multimodal approach. Multimodal learning in marketing is explored, focusing on understanding trends and preferences by analyzing behavior patterns expressed in different modalities. The study suggests that research in multimodality is scarce but reveals that it is as a promising field for overcoming decision-making complexity and developing innovative marketing strategies. The article introduces a methodology for accurately representing multimodal elements and discusses the theoretical foundations and practical impact of multimodal learning. It also examines the use of embeddings, fusion techniques, and explores model performance evaluation. The review acknowledges the limitations of current multimodal approaches in marketing and encourages more guidelines for future research. Overall, this work emphasizes the importance of integrating intelligent technology in marketing to personalize customer experiences and improve decision-making processes.

2025

A Reinforcement Learning Based Recommender System Framework for Web Apps: Radio and Game Aggregators Scenarios

Autores
Batista, A; Torres, JM; Sobral, P; Moreira, RS; Soares, C; Pereira, I;

Publicação
PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2024, PT I

Abstract
Recommendation systems can play an important role in today's digital content platforms by supporting the suggestion of relevant content in a personalised manner for each customer. Such content customisation has not been consistent across most media domains, and particularly on radio streaming and gaming aggregators, which are the two real-world application domains focused in this work. The challenges faced in these application areas are the dynamic nature of user preferences and the difficulty of generating recommendations for less popular content, due to the overwhelming choice and polarisation of available top content. We present the design and implementation of a Reinforcement Learning-based Recommendation System (RLRS) for web applications, using a Deep Deterministic Policy Gradient (DDPG) agent and, as a reward function, a weighted sum of the user Click Distribution (CD) across the recommended items and the Dwell Time (DT), a measure of the time users spend interacting with those items. Our system has been deployed in real production scenarios with preliminary but promising results. Several metrics are used to track the effectiveness of our approach, such as content coverage, category diversity, and intra-list similarity. In both scenarios tested, the system shows consistent improvement and adaptability over time, reinforcing its applicability.

2024

Object and Event Detection Pipeline for Rink Hockey Games

Autores
Lopes, JM; Mota, LP; Mota, SM; Torres, JM; Moreira, RS; Soares, C; Pereira, I; Gouveia, F; Sobral, P;

Publicação

Abstract
All types of sports are potential application scenarios for automatic and real-time visual object and event detection. In rink hockey, the popular roller quad skate variant of hockey team sports, it is of great interest to automatically track player’s movements and positions, player’s sticks and, also, making other judgments, such as being able to locate the ball. In this work, we introduce a real-time pipeline composed by an object detection model, created specifically for rink hockey games, followed by a knowledge-based event detection module. Even in the presence of occlusions and quick motions, our deep learning object detection model effectively identifies and tracks, in real-time, important visual elements such as: ball; players; sticks; referees; crowd; goalkeeper; and goal. Using a curated dataset composed by a collection of videos of rink hockey, comprising 2525 annotated frames, we trained and evaluated the algorithm performance and compare it to state of the art object detection techniques. Our object detection model, based on YOLOv7, presents a global accuracy of 80%, and presents a good performance in terms of accuracy and speed, according to our results, making it a good choice for rink hockey applications. In our initial tests, the event detection module successfully detected one important event type in rink hockey games, the occurrence of penalties.

2024

Optimization strategies in SEI: An analysis of SARIMA and additive Holt-Winters models

Autores
Cristino, C; Nicola, S; Costa, J; Bettencourt, N; Madureira, A; Pereira, I; Costa, A;

Publicação
2024 IEEE 22ND MEDITERRANEAN ELECTROTECHNICAL CONFERENCE, MELECON 2024

Abstract
This paper focuses on the importance of Business Intelligence (BI) tools in the business context and the urgent need for more effective implementation of time series forecasting models in these resources. It shows the utility and applicability of Sage Enterprise Intelligence (SEI), an integrated BI tool in Enterprise Resource Planning (ERP) Sage, by illustrating how it enhances data analysis and decision-making processes. Additionally, a study will show the application of time series forecasting models: Seasonal AutoRegressive Integrated Moving Average (SARIMA) and additive Holt-Winters to the sales value of a fuel sector company. The research was conducted through a case study in which sales data were collected from 2016 to 2023. The results indicate that neither of the two models exceeded the sales figures reflecting the company's market position. In this case study, both models performed well, with the residuals verifying the assumptions. However, the additive Holt-Winters model had lower errors, which is why it was selected for the final step: forecasting 12 months.

2024

A case study on phishing detection with a machine learning net

Autores
Bezerra, A; Pereira, I; Rebelo, MA; Coelho, D; de Oliveira, DA; Costa, JFP; Cruz, RPM;

Publicação
INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS

Abstract
Phishing attacks aims to steal sensitive information and, unfortunately, are becoming a common practice on the web. Email phishing is one of the most common types of attacks on the web and can have a big impact on individuals and enterprises. There is still a gap in prevention when it comes to detecting phishing emails, as new attacks are usually not detected. The goal of this work was to develop a model capable of identifying phishing emails based on machine learning approaches. The work was performed in collaboration with E-goi, a multi-channel marketing automation company. The data consisted of emails collected from the E-goi servers in the electronic mail format. The problem consisted of a classification problem with unbalanced classes, with the minority class corresponding to the phishing emails and having less than 1% of the total emails. Several models were evaluated after careful data selection and feature extraction based on the email content and the literature regarding these types of problems. Due to the imbalance present in the data, several sampling methods based on under-sampling techniques were tested to see their impact on the model's ability to detect phishing emails. The final model consisted of a neural network able to detect more than 80% of phishing emails without compromising the remaining emails sent by E-goi clients.

2024

A Systematic Review on Responsible Multimodal Sentiment Analysis in Marketing Applications

Autores
César, I; Pereira, I; Rodrigues, F; Miguéis, VL; Nicola, S; Madureira, A; Reis, JL; Dos Santos, JPM; De Oliveira, DA;

Publicação
IEEE ACCESS

Abstract
The intrinsic challenges of contemporary marketing encourage discovering new approaches to engage and retain customers effectively. As the main channels of interactions between customers and brands pivot between the physical and the digital world, analyzing the outcome behavioral patterns must be achieved dynamically with the stimulus performed in both poles. This systematic review investigates the collaborative impact of adopting multidisciplinary fields of Affective Computing to evaluate current marketing strategies, upholding the process of using multimodal information from consumers to perform and integrate Sentiment Analysis tasks. The adjusted representation of modalities such as textual, visual, audio, or even psychological indicators enables prospecting a more precise assessment of the advantages and disadvantages of the proposed technique, glimpsing future applications of Multimodal Artificial Intelligence in Marketing. Embracing the Preferred Reporting Items for Systematic Reviews and Meta-Analysis as the research method to be applied, this article warrants a rigorous and sequential identification and interpretation of the synergies between the latest studies about affective computing and marketing. Furthermore, the robustness of the procedure is deepened in knowledge-gathering concerning the current state of Affective Computing in the Marketing area, their technical practices, ethical and legal considerations, and the potential upcoming applications, anticipating insights for the ongoing work of marketers and researchers.

  • 2
  • 9