Nuno Miguel Paulino

Abstract

Abstract
Telecommunications and computer vision solutions have evolved significantly in recent years, allowing a huge advance in the functionalities and applications offered. However, these two fields have been making their way as separate areas, not exploring the potential benefits of merging the innovations brought from each of them. In challenging environments, for example, combining radio sensing and computer vision can strongly contribute to solving problems such as those introduced by obstructions or limited lighting. Machine learning algorithms, able to fuse heterogeneous and multi-modal data, are also a key element for understanding and inferring additional knowledge from raw and low-level data, able to create a new abstracting level that can significantly enhance many applications. This paper introduces the CONVERGE vision-radio concept, a new paradigm that explores the benefits of integrating two fields of knowledge towards the vision of View-to-Communicate, Communicate-to-View. The main concepts behind this vision, including supporting use cases and the proposed architecture, are presented. CONVERGE introduces a set of tools integrating wireless communications and computer vision to create a novel experimental infrastructure that will provide open datasets to the scientific community of both experimental and simulated data, enabling new research addressing various 6 G verticals, including telecommunications, automotive, manufacturing, media, and health.

Abstract
The rapid proliferation of Edge AI applications demands efficient, low-power computing architectures tailored to specific workloads. The RISC-V ecosystem is a promising solution, and has led to a fast growth of implementations based on custom instructions extensions, but with varying degrees of functionality and support which may hinder easy adoption. In this paper, we extensively review existing RISC-V extensions targeting primarily the AI domain and respective compilation flows, highlighting challenges in deployment, usability, and compatibility. We further implement and provide usable containerized environments for two of these works. To address the identified challenges, we then propose an approach for lightweight early validation of custom instructions via source-to-source transformations, without need of compiler modifications. We target our own Single Instruction Multiple Data (SIMD) accelerator, which we integrate into a CORE-V cv32e40px baseline core through custom instructions, and versus which we achieve up to 11.9x speedup for matrix-vector operations.

Abstract
Human Activity Recognition (HAR) is the identification and classification of static and dynamic human activities, which find applicability in domains like healthcare, entertainment, security, and cyber-physical systems. Traditional HAR approaches rely on wearable sensors, vision-based systems, or ambient sensing, each with inherent limitations such as privacy concerns or restricted sensing conditions. Instead, Radio Frequency (RF)-based HAR relies on the interaction of RF signals with people to infer activities. Reconfigurable Intelligent Surfaces (RISs) are significant for this use-case by allowing dynamic control over the wireless environment, enhancing the information extracted from RF signals. We present an Hand Gesture Recognition (HGR) approach using our own 6.5GHz RIS design, which we use to gather a dataset for HGR classification for three different hand gestures. By employing two Convolutional Neural Networks (CNNs) models trained on data gathered under random and optimized RIS configuration sequences, we achieved classification accuracies exceeding 90%.

Abstract
Wi-Fi 6E will enable dense communications with low latency and high throughput, meeting the demands of ever growing network traffic and supporting emergent services such as ultra HD or multi-video streaming, and augmented or virtual reality. However, the 6GHz band suffers from higher path loss and signal attenuation, and poor performance in NLoS conditions. Reconfigurable Intelligent Surfaces (RISs) can address these challenges by providing low-cost directional communications with increased spectral and energy efficiency. However, RIS designs for the WiFi-6E range are under-explored in literature. We present the implementation of an 8x8 RIS tuned for 6.5GHz designed for scalability. We characterize the response of the unit cell, and evaluate the RIS in an anechoic chamber, measuring the far field radiation patterns for several digital beamsteering configurations in a horizontal plane, demonstrating effective signal steering.