2024
Authors
Moita, S; Moreira, RS; Gouveia, F; Torres, JM; Gerreiro, MS; Ferreira, D; Sucena, S; Dinis, MA;
Publication
2024 INTERNATIONAL CONFERENCE ON SMART APPLICATIONS, COMMUNICATIONS AND NETWORKING, SMARTNETS-2024
Abstract
There is a widespread social awareness for the need of adequate accessibility (e.g. missing ramps at crosswalks, obstacles and potholes at sidewalks) in the planning of safe and inclusive city spaces for all citizens. Therefore, municipal authorities responsible for planning urban spaces could benefit from the use of tools for automating the identification of areas in need of accessibility improving interventions. This paper builds on the assumption that it is possible to use Machine Learning (ML) pipelines for automating the detection of accessibility constraints in public spaces, particularly on sidewalks. Those pipelines rely mostly on Deep Learning algorithms to automate the detection of common accessibility issues. Current literature approaches rely on the use of traditional classifiers focused on images' datasets containing single-labelled accessibility classes. We propose an alternative approach using object-detection models that provide a more generic and human-like mode, as it will look into wider city pictures to spot multiple accessibility problems at once. Hence, we evaluate and compare the results of a more generic YOLO model against previous results obtained by more traditional ResNet classification models. The ResNet models used in Project Sidewalk were trained and tested on per-city basis datasets of images crowd-labeled with accessibility attributes. By combining the use of the Project Sidewalk and Google Street View (GSV) service APIs, we re-assembled a world-cities-mix dataset used to train, validate and test the YOLO object-detection model, which exhibited precision and recall values above 84%. Our team of architects and civil engineers also collected a labeled image dataset from two central areas of Porto city, which was used to jointly train and test the YOLO model. The results show that training (even with a small dataset of Porto) the cities-mix-trained YOLO model, provides comparable precision values against the ones obtained by ResNet per-city classifiers. Furthermore, the YOLO approach offers a more human-like generic and efficient pipeline, thus justifying its future exploitation on automating cataloging accessibility mappings in cities.
2024
Authors
Lopes, JM; Mota, LP; Mota, SM; Torres, JM; Moreira, RS; Soares, C; Pereira, I; Gouveia, F; Sobral, P;
Publication
Abstract
2024
Authors
Lopes, JM; Mota, LP; Mota, SM; Torres, JM; Moreira, RS; Soares, C; Pereira, I; Gouveia, FR; Sobral, P;
Publication
FUTURE INTERNET
Abstract
All types of sports are potential application scenarios for automatic and real-time visual object and event detection. In rink hockey, the popular roller skate variant of team hockey, it is of great interest to automatically track player movements, positions, and sticks, and also to make other judgments, such as being able to locate the ball. In this work, we present a real-time pipeline consisting of an object detection model specifically designed for rink hockey games, followed by a knowledge-based event detection module. Even in the presence of occlusions and fast movements, our deep learning object detection model effectively identifies and tracks important visual elements in real time, such as: ball, players, sticks, referees, crowd, goalkeeper, and goal. Using a curated dataset consisting of a collection of rink hockey videos containing 2525 annotated frames, we trained and evaluated the algorithm's performance and compared it to state-of-the-art object detection techniques. Our object detection model, based on YOLOv7, presents a global accuracy of 80% and, according to our results, good performance in terms of accuracy and speed, making it a good choice for rink hockey applications. In our initial tests, the event detection module successfully detected an important event type in rink hockey games, namely, the occurrence of penalties.
2024
Authors
Barros, N; Sobral, P; Moreira, RS; Vargas, J; Fonseca, A; Abreu, I; Guerreiro, MS;
Publication
SENSORS
Abstract
Indoor air quality (IAQ) problems in school environments are very common and have significant impacts on students' performance, development and health. Indoor air conditions depend on the adopted ventilation practices, which in Mediterranean countries are essentially based on natural ventilation controlled through manual window opening. Citizen science projects directed to school communities are effective strategies to promote awareness and knowledge acquirement on IAQ and adequate ventilation management. Our multidisciplinary research team has developed a framework-SchoolAIR-based on low-cost sensors and a scalable IoT system architecture to support the improvement of IAQ in schools. The SchoolAIR framework is based on do-it-yourself sensors that continuously monitor air temperature, relative humidity, concentrations of carbon dioxide and particulate matter in school environments. The framework was tested in the classrooms of University Fernando Pessoa, and its deployment and proof of concept took place in a high school in the north of Portugal. The results obtained reveal that CO2 concentrations frequently exceed reference values during classes, and that higher concentrations of particulate matter in the outdoor air affect IAQ. These results highlight the importance of real-time monitoring of IAQ and outdoor air pollution levels to support decision-making in ventilation management and assure adequate IAQ. The proposed approach encourages the transfer of scientific knowledge from universities to society in a dynamic and active process of social responsibility based on a citizen science approach, promoting scientific literacy of the younger generation and enhancing healthier, resilient and sustainable indoor environments.
2024
Authors
Torres, JM; Oliveira, S; Sobral, PM; Moreira, RS; Soares, C;
Publication
SN Comput. Sci.
Abstract
We spend about one-third of our life either sleeping or attempting to do so. Sleeping is a key aspect for most human body processes, affecting physical and mental health and the ability to fight diseases, develop immunity and control metabolism. Therefore, monitoring human sleep quality is extremely important for the detection of possible sleep disorders. Several technologies exist to achieve this goal, however, most of them are expensive proprietary systems, some require hospitalization and many use intrusive equipment that can, by itself, affect sleep quality. This paper presents an intelligent system, a complete low-cost hardware and software solution, for monitoring the sleep quality of an individual in a home environment. User privacy is guaranteed as all processing is done at the edge and no audio or video is stored. This system monitors several fundamental aspects of sleeping periods in real-time using a low cost single-board computer for processing, a camera for body motion detection (MD module) and for eye/sleep status detection (SSD module), and a microphone for audio recognition (AUDR module) of breath pattern analysis and snore detection. It can be strategically placed near the bed to avoid interfering with the natural sleep pattern. For each sleeping period, the system produces a final report that can be a valuable aid for improving the sleeping health of the monitored person. Functional unitary tests were carried successfully on the selected, low-cost, hardware platform (Raspberry Pi). The entire process was validated by an expert clinical psychologist, ensuring the reliability and effectiveness of the system. The visual and sound modules use sophisticated computer vision and machine learning techniques suitable for edge computing devices. Each of the system’s features have been independently tested, using properly organized audio and video datasets and the well established metrics of precision, recall and F1 score, to evaluate the binary classifiers in each of the three modules. The accuracy values obtained where 90.2% (MD), 79.1% (SSD) and 81.3% (AUDR), demonstrating the great application potential of our solution.
2024
Authors
Gomes, B; Soares, C; Torres, JM; Karmali, K; Karmali, S; Moreira, RS; Sobral, P;
Publication
SENSORS
Abstract
In Portugal, more than 98% of domestic cooking oil is disposed of improperly every day. This avoids recycling/reconverting into another energy. Is also may become a potential harmful contaminant of soil and water. Driven by the utility of recycled cooking oil, and leveraging the exponential growth of ubiquitous computing approaches, we propose an IoT smart solution for domestic used cooking oil (UCO) collection bins. We call this approach SWAN, which stands for Smart Waste Accumulation Network. It is deployed and evaluated in Portugal. It consists of a countrywide network of collection bin units, available in public areas. Two metrics are considered to evaluate the system's success: (i) user engagement, and (ii) used cooking oil collection efficiency. The presented system should (i) perform under scenarios of temporary communication network failures, and (ii) be scalable to accommodate an ever-growing number of installed collection units. Thus, we choose a disruptive approach from the traditional cloud computing paradigm. It relies on edge node infrastructure to process, store, and act upon the locally collected data. The communication appears as a delay-tolerant task, i.e., an edge computing solution. We conduct a comparative analysis revealing the benefits of the edge computing enabled collection bin vs. a cloud computing solution. The studied period considers four years of collected data. An exponential increase in the amount of used cooking oil collected is identified, with the developed solution being responsible for surpassing the national collection totals of previous years. During the same period, we also improved the collection process as we were able to more accurately estimate the optimal collection and system's maintenance intervals.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.