Abstract

Abstract
Whispers are common and essential for secondary communication. Nonetheless, individuals with aphonia, including laryngectomees, rely on whispers as their primary means of communication. Due to the distinct features between whispered and regular speech, debates have emerged in the field of speech recognition, highlighting the challenge of effectively converting between them. This study investigates the characteristics of whispered speech and proposes a system for converting whispered vowels into normal ones. The system is developed using multilayer perceptron networks and two types of generative adversarial networks. Three metrics are analyzed to evaluate the performance of the system: mel-cepstral distortion, root mean square error of the fundamental frequency, and accuracy with f1-score of a vowel classifier. Overall, the perceptron networks demonstrated better results, with no significant differences observed between male and female voices or the presence/absence of speech silence, except for improved accuracy in estimating the fundamental frequency during the conversion process. © 2025, Universidade do Porto - Faculdade de Engenharia. All rights reserved.

Abstract
High-frequency radio networks, including those operating in the millimeter-wave bands, are sensible to Line-of-Sight (LoS) obstructions. Computer Vision (CV) algorithms can be leveraged to improve network performance by processing and interpreting visual data, enabling obstacle avoidance and ensuring LoS signal propagation. We propose a vision-aided Radio Access Network (RAN) based on the O-RAN architecture and capable of perceiving the surrounding environment. The vision-aided RAN consists of a gNodeB (gNB) equipped with a video camera that employs CV techniques to extract critical environmental information. An xApp is used to collect and process metrics from the RAN and receive data from a Vision Module (VM). This enhances the RAN's ability to perceive its surroundings, leading to better connectivity in challenging environments. © 2025 IFIP.

Abstract

Abstract
Audio-visual correlation learning aims to capture and understand natural phenomena between audio and visual data. The rapid growth of Deep Learning propelled the development of proposals that process audio-visual data and can be observed in the number of proposals in the past years. Thus encouraging the development of a comprehensive survey. Besides analyzing the models used in this context, we also discuss some tasks of definition and paradigm applied in AI multimedia. In addition, we investigate objective functions frequently used and discuss how audio-visual data is exploited in the optimization process, i.e., the different methodologies for representing knowledge in the audio-visual domain. In fact, we focus on how human-understandable mechanisms, i.e., structured knowledge that reflects comprehensible knowledge, can guide the learning process. Most importantly, we provide a summarization of the recent progress of Audio-Visual Correlation Learning (AVCL) and discuss the future research directions.

Abstract
There was an error in the original publication [...]