2021
Authors
Magalhaes, SA; Castro, L; Moreira, G; dos Santos, FN; Cunha, M; Dias, J; Moreira, AP;
Publication
SENSORS
Abstract
The development of robotic solutions for agriculture requires advanced perception capabilities that can work reliably in any crop stage. For example, to automatise the tomato harvesting process in greenhouses, the visual perception system needs to detect the tomato in any life cycle stage (flower to the ripe tomato). The state-of-the-art for visual tomato detection focuses mainly on ripe tomato, which has a distinctive colour from the background. This paper contributes with an annotated visual dataset of green and reddish tomatoes. This kind of dataset is uncommon and not available for research purposes. This will enable further developments in edge artificial intelligence for in situ and in real-time visual tomato detection required for the development of harvesting robots. Considering this dataset, five deep learning models were selected, trained and benchmarked to detect green and reddish tomatoes grown in greenhouses. Considering our robotic platform specifications, only the Single-Shot MultiBox Detector (SSD) and YOLO architectures were considered. The results proved that the system can detect green and reddish tomatoes, even those occluded by leaves. SSD MobileNet v2 had the best performance when compared against SSD Inception v2, SSD ResNet 50, SSD ResNet 101 and YOLOv4 Tiny, reaching an F1-score of 66.15%, an mAP of 51.46% and an inference time of 16.44 ms with the NVIDIA Turing Architecture platform, an NVIDIA Tesla T4, with 12 GB. YOLOv4 Tiny also had impressive results, mainly concerning inferring times of about 5 ms.
2021
Authors
Santos, MF; Honorio, LM; Moreira, APGM; Silva, MF; Vidal, VF;
Publication
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS
Abstract
This paper presents a novel light-weighted Unmanned Aerial Vehicle (UAV), an over-actuated tilt-rotor quadrotor with an innovative control allocation technique, named as Fast Control Allocation (FCA). In this arrangement, every motor has its own independent tilting command angle. By using this novel approach, the aircraft enhances its yawing capability and increases one more actuation domain: forward/backward velocity. However, this approach generates a control allocation matrix with non-unique solutions, breaking the effectiveness matrix into two parts. The first one is created considering the yawing torque and forward/backward velocity, and the second one considers all aircraft dynamics, running iteratively until the convergence criteria are reached. The results showed a well designed UAV where the FCA convergence and robustness was visible, allowing reliable and safe flight conditions with low computational effort control boards.
2021
Authors
Magalhães, SA; Moreira, AP; dos Santos, FN; Dias, J; Santos, L;
Publication
Intelligent Systems and Applications - Proceedings of the 2021 Intelligent Systems Conference, IntelliSys 2021, Amsterdam, The Netherlands, 2-3 September, 2021, Volume 3
Abstract
Nowadays, robotic manipulators’ uses are broader than industrial needs. They are applied to perform agricultural tasks, consumer services, medical surgeries, among others. The development of new cost-effective robotic arms assumes a prominent position to enable their wide-spread adoption in these application areas. Bearing these ideas in mind, the objective of this paper is twofold. First, introduce the hardware and software architecture and position-control design for a four Degree of Freedom (DoF) manipulator constituted by high-resolution stepper motors and incremental encoders and a cost-effective price. Secondly, to describe the mitigation strategies adopted to lead with the manipulator’s position using incremental encoders during startup and operating modes. The described solution has a maximum circular workspace of 0.7 m and a maximum payload of 3 kg. The developed architecture was tested, inducing the manipulator to perform a square path. Tests prove an accumulative error of 12.4 mm. All the developed code for firmware and ROS drivers was made publicly available. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.
2021
Authors
Pires, F; Ahmad, B; Moreira, AP; Leitão, P;
Publication
4th IEEE International Conference on Industrial Cyber-Physical Systems, ICPS 2021, Victoria, BC, Canada, May 10-12, 2021
Abstract
2021
Authors
Soares, I; Sousa, RB; Petry, M; Moreira, AP;
Publication
MULTIMODAL TECHNOLOGIES AND INTERACTION
Abstract
Augmented and virtual reality have been experiencing rapid growth in recent years, but there is still no deep knowledge regarding their capabilities and in what fields they could be explored. In that sense, this paper presents a study on the accuracy and repeatability of Microsoft's HoloLens 2 (augmented reality device) and HTC Vive (virtual reality device) using an OptiTrack system as ground truth. For the HoloLens 2, the method used was hand tracking, whereas, in HTC Vive, the object tracked was the system's hand controller. A series of tests in different scenarios and situations were performed to explore what could influence the measures. The HTC Vive obtained results in the millimeter range, while the HoloLens 2 revealed not very accurate measurements (around 2 cm). Although the difference can seem to be considerable, the fact that HoloLens 2 was tracking the user's hand and not the system's controller made a huge impact. The results are considered a significant step for the ongoing project of developing a human-robot interface by demonstrating an industrial robot using extended reality, which shows great potential to succeed based on our data.
2021
Authors
Baltazar, AR; dos Santos, FN; Moreira, AP; Valente, A; Cunha, JB;
Publication
ELECTRONICS
Abstract
The automation of agricultural processes is expected to positively impact the environment by reducing waste and increasing food security, maximising resource use. Precision spraying is a method used to reduce the losses during pesticides application, reducing chemical residues in the soil. In this work, we developed a smart and novel electric sprayer that can be assembled on a robot. The sprayer has a crop perception system that calculates the leaf density based on a support vector machine (SVM) classifier using image histograms (local binary pattern (LBP), vegetation index, average, and hue). This density can then be used as a reference value to feed a controller that determines the air flow, the water rate, and the water density of the sprayer. This perception system was developed and tested with a created dataset available to the scientific community and represents a significant contribution. The results of the leaf density classifier show an accuracy score that varies between 80% and 85%. The conducted tests prove that the solution has the potential to increase the spraying accuracy and precision.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.