2024
Authors
Magalhães, SC; Moreira, AP; dos Santos, FN; Dias, J;
Publication
Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics, ICINCO 2024, Porto, Portugal, November 18-20, 2024, Volume 2.
Abstract
RGB-D sensors face multiple challenges operating under open-field environments because of their sensitivity to external perturbations such as radiation or rain. Multiple works are approaching the challenge of perceiving the three-dimensional (3D) position of objects using monocular cameras. However, most of these works focus mainly on deep learning-based solutions, which are complex, data-driven, and difficult to predict. So, we aim to approach the problem of predicting the three-dimensional (3D) objects’ position using a Gaussian viewpoint estimator named best viewpoint estimator (BVE), powered by an extended Kalman filter (EKF). The algorithm proved efficient on the tasks and reached a maximum average Euclidean error of about 32mm. The experiments were deployed and evaluated in MATLAB using artificial Gaussian noise. Future work aims to implement the system in a robotic system. © 2024 by SCITEPRESS-Science and Technology Publications, Lda.
2024
Authors
Pinheiro, I; Moreira, G; Magalhaes, S; Valente, A; Cunha, M; dos Santos, FN;
Publication
SCIENTIFIC REPORTS
Abstract
Pollination is critical for crop development, especially those essential for subsistence. This study addresses the pollination challenges faced by Actinidia, a dioecious plant characterized by female and male flowers on separate plants. Despite the high protein content of pollen, the absence of nectar in kiwifruit flowers poses difficulties in attracting pollinators. Consequently, there is a growing interest in using artificial intelligence and robotic solutions to enable pollination even in unfavourable conditions. These robotic solutions must be able to accurately detect flowers and discern their genders for precise pollination operations. Specifically, upon identifying female Actinidia flowers, the robotic system should approach the stigma to release pollen, while male Actinidia flowers should target the anthers to collect pollen. We identified two primary research gaps: (1) the lack of gender-based flower detection methods and (2) the underutilisation of contemporary deep learning models in this domain. To address these gaps, we evaluated the performance of four pretrained models (YOLOv8, YOLOv5, RT-DETR and DETR) in detecting and determining the gender of Actinidia flowers. We outlined a comprehensive methodology and developed a dataset of manually annotated flowers categorized into two classes based on gender. Our evaluation utilised k-fold cross-validation to rigorously test model performance across diverse subsets of the dataset, addressing the limitations of conventional data splitting methods. DETR provided the most balanced overall performance, achieving precision, recall, F1 score and mAP of 89%, 97%, 93% and 94%, respectively, highlighting its robustness in managing complex detection tasks under varying conditions. These findings underscore the potential of deep learning models for effective gender-specific detection of Actinidia flowers, paving the way for advanced robotic pollination systems.
2024
Authors
Magalhaes, SAC; dos Santos, FN; Moreira, AP; Dias, JMM;
Publication
ROBOTICA
Abstract
Performing tasks in agriculture, such as fruit monitoring or harvesting, requires perceiving the objects' spatial position. RGB-D cameras are limited under open-field environments due to lightning interferences. So, in this study, we state to answer the research question: How can we use and control monocular sensors to perceive objects' position in the 3D task space? Towards this aim, we approached histogram filters (Bayesian discrete filters) to estimate the position of tomatoes in the tomato plant through the algorithm MonoVisual3DFilter. Two kernel filters were studied: the square kernel and the Gaussian kernel. The implemented algorithm was essayed in simulation, with and without Gaussian noise and random noise, and in a testbed at laboratory conditions. The algorithm reported a mean absolute error lower than 10 mm in simulation and 20 mm in the testbed at laboratory conditions with an assessing distance of about 0.5 m. So, the results are viable for real environments and should be improved at closer distances.
2023
Authors
Moreira, G; Magalhães, SA; dos Santos, FN; Cunha, M;
Publication
IECAG 2023
Abstract
2023
Authors
Marques, MN; Magalhaes, SA; Dos Santos, FN; Mendonca, HS;
Publication
ROBOTICS
Abstract
In recent years, there has been a remarkable surge in the development and research of tethered aerial systems, thus reflecting a growing interest in their diverse applications. Long-term missions involving aerial vehicles present significant challenges due to the limitations of current battery solutions. Tethered vehicles can circumvent such restrictions by receiving their power from an element on the ground such as a ground station or a mobile terrestrial platform. Tethered Unmanned Aerial Vehicles (UAVs) can also be applied to load transportation achieved by a single or multiple UAVs. This paper presents a comprehensive systematic literature review, with a special focus on solutions published in the last five years (2017-2022). It emphasizes the key characteristics that are capable of grouping publications by application scope, propulsion method, energy transfer solution, perception sensors, and control techniques adopted. The search was performed in six different databases, thereby resulting in 1172 unique publications, from which 182 were considered for inclusion in the data extraction phase of this review. Among the various aircraft types, multirotors emerged as the most widely used category. We also identified significant variations in the application scope of tethered UAVs, thus leading to tailored approaches for each use case, such as the fixed-wing model being predominant in the wind generation application and the lighter-than-air aircraft in the meteorology field. Notably, the classical Proportional-Integral-Derivative (PID) control scheme emerged as the predominant control methodology across the surveyed publications. Regarding energy transfer techniques, most publications did not explicitly describe their approach. However, among those that did, high-voltage DC energy transfer emerged as the preferred solution. In summary, this systematic literature review provides valuable insights into the current state of tethered aerial systems, thereby showcasing their potential as a robust and sustainable alternative to address the challenges associated with long-duration aerial missions and load transportation.
2022
Authors
Magalhães, SC; dos Santos, FN; Machado, P; Moreira, AP; Dias, J;
Publication
CoRR
Abstract
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.