Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Interest
Topics
Details

Details

  • Name

    Ivo Pereira
  • Role

    Senior Researcher
  • Since

    17th January 2024
Publications

2025

Multimodal Learning Applications on Digital Marketing: A Review

Authors
César I.; Pereira I.; Rodrigues F.; Miguéis V.; Nicola S.; Madureira A.;

Publication
Lecture Notes in Networks and Systems

Abstract
The effectiveness of digital marketing relies on the seamless integration of intelligent technology, enabling encounters that closely resemble those experienced with physical vendors in the real world. Thus, the importance of scalable artificial intelligence (AI) systems guided by a multimodal approach cannot be overstated, as they can be used to gain a deeper understanding of user preferences and engagement behaviors. The investigation conducted concerning multimodal learning in this review uncovers a variety of benefits and limitations on the available data, presenting consistency in finding the relationship between modalities. The results suggest multimodality as a topic with a noticeable dearth of research, yet a promising path to reduce uncertainty and develop innovative perspectives on decision-making for Digital Marketing improvement tasks. The complexity inherent in data processes like analysis, processing, and granular modulation requires a lot of effort for researchers to build accurate multimodal representations while trying to suppress imprecision in these new elements. Therefore, our approach aims to explore how theoretical foundations are successfully applied to learning operational procedures, considering real-life case comprehension, the technical challenges of the learning process, and the importance given to each feature. Even so, comparing the restrictions found in the state-of-the-art made possible the reformulation of limitations to this particular type of technology and encouraged the search for more guidelines on the entire process.

2025

Enhancing Consumer Insights Through Multimodal Artificial Intelligence and Affective Computing

Authors
César, I; Pereira, I; Rodrigues, F; Miguéis, VL; Nicola, S; Madureira, A; Reis, JL; Dos Santos, JPM; Coelho, D; De Oliveira, DA;

Publication
IEEE ACCESS

Abstract
The growing interest in learning more about consumer behaviors through analytical techniques requires the integration of innovative approaches that relate their needs to strategic marketing procedures. Multimodality and Affective Computing combined a series of robust optimizations for this challenge, implying the complexity of each application. However, the entanglement of different modalities demands new and tailored refinements to enhance adaptability and accuracy in the field. This paper outlines the implementation of a Multimodal Artificial Intelligence methodology with Affective Computing to enhance consumer insights and marketing strategies. The application combines different data modalities, such as textual, visual, and audio inputs, to tackle complex issues in dealing with consumer sentiment. The proposed approach uses advanced preprocessing techniques, including word embeddings, neural networks, and recurrent models, to extract information from diverse modalities. Fusion strategies, such as attention-based and late fusion procedures, are utilized to combine knowledge, facilitating robust sentiment detection. The implementation includes the analysis of real-time customer feedback on social media and product assessments, demonstrating improvements in predicting engagement and shaping consumer behavior. The results underscore the practical viability of the suggested method, promoting progress in multimodal sentiment analysis to extract actionable consumer insights in marketing.

2025

Exploring multimodal learning applications in marketing: A critical perspective

Authors
César, I; Pereira, I; Rodrigues, F; Miguéis, VL; Nicola, S; Madureira, A;

Publication
Int. J. Hybrid Intell. Syst.

Abstract
This review discusses the integration of intelligent technologies into customer interactions in organizations and highlights the benefits of using artificial intelligence systems based on a multimodal approach. Multimodal learning in marketing is explored, focusing on understanding trends and preferences by analyzing behavior patterns expressed in different modalities. The study suggests that research in multimodality is scarce but reveals that it is as a promising field for overcoming decision-making complexity and developing innovative marketing strategies. The article introduces a methodology for accurately representing multimodal elements and discusses the theoretical foundations and practical impact of multimodal learning. It also examines the use of embeddings, fusion techniques, and explores model performance evaluation. The review acknowledges the limitations of current multimodal approaches in marketing and encourages more guidelines for future research. Overall, this work emphasizes the importance of integrating intelligent technology in marketing to personalize customer experiences and improve decision-making processes.

2025

A Reinforcement Learning Based Recommender System Framework for Web Apps: Radio and Game Aggregators Scenarios

Authors
Batista, A; Torres, JM; Sobral, P; Moreira, RS; Soares, C; Pereira, I;

Publication
PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2024, PT I

Abstract
Recommendation systems can play an important role in today's digital content platforms by supporting the suggestion of relevant content in a personalised manner for each customer. Such content customisation has not been consistent across most media domains, and particularly on radio streaming and gaming aggregators, which are the two real-world application domains focused in this work. The challenges faced in these application areas are the dynamic nature of user preferences and the difficulty of generating recommendations for less popular content, due to the overwhelming choice and polarisation of available top content. We present the design and implementation of a Reinforcement Learning-based Recommendation System (RLRS) for web applications, using a Deep Deterministic Policy Gradient (DDPG) agent and, as a reward function, a weighted sum of the user Click Distribution (CD) across the recommended items and the Dwell Time (DT), a measure of the time users spend interacting with those items. Our system has been deployed in real production scenarios with preliminary but promising results. Several metrics are used to track the effectiveness of our approach, such as content coverage, category diversity, and intra-list similarity. In both scenarios tested, the system shows consistent improvement and adaptability over time, reinforcing its applicability.

2025

Leveraging Feature Extraction to Perform Time-Efficient Selection for Machine Learning Applications

Authors
Coelho, D; Madureira, A; Pereira, I; Gonçalves, R; Nicola, S; César, I; de Oliveira, DA;

Publication
APPLIED SCIENCES-BASEL

Abstract
In the age of rapidly advancing machine learning capabilities, the pursuit of maximum performance encounters the practical limitations imposed by limited resources in several fields. This work presents a cost-effective proposal for feature selection, which is a crucial part of machine learning processes, and intends to partly solve this problem through computational time reduction. The proposed methodology aims to strike a careful balance between feature exploration and strict computational time concerns, by enhancing the quality and relevance of data. This approach focuses on the use of interim representations of feature combinations to significantly speed up a potentially slow and computationally expensive process. This strategy is evaluated in several datasets against other feature selection methods, and the results indicate a significant reduction in the temporal costs associated with this process, achieving a mean percentage decrease of 85%. Furthermore, this reduction is achieved while maintaining competitive model performance, demonstrating that the selected features remain effective for the learning task. These results emphasize the method's feasibility, confirming its ability to transform machine learning applications in environments with limited resources.