2025
Authors
Cordeiro, A; Rocha, LF; Boaventura-Cunha, J; Pires, EJS; Souza, JP;
Publication
COMPUTERS & INDUSTRIAL ENGINEERING
Abstract
The implementation of deep learning approaches based on instance segmentation data remains a challenge for customized scenarios, owing to the time-consuming nature of acquiring and annotating real-world instance segmentation data, which requires a significant investment of semi-professional user labour. Obtaining high-quality labelled data demands expertise and meticulous attention to detail. This requirement can significantly impact the overall implementation process, adding to the complexity and resource requirements of customized scenarios with diverse objects. The proposed work addresses the challenge of generating labelled data for large-scale robotic bin-picking datasets by proposing an easy-to-use automated framework designed to create customized data with accurate labels from CAD models. The framework leverages a photorealistic rendering engine integrated with physics simulation, minimizing the gap between synthetic and real-world data. Models trained using the synthetic data generated by this framework achieved an Average Precision of 86.95%, comparable to the performance of models trained on real-world datasets. Furthermore, this paper provides a comprehensive multi-metric analysis across diverse objects representing distinct industrial applications, including naval, logistics, and aerospace domains. The evaluation also includes the use of three distinct instance segmentation networks, alongside a comparative analysis of the proposed approach against two generative model techniques.
2024
Authors
Caldana, D; Cordeiro, A; Sousa, JP; Sousa, RB; Rebello, PM; Silva, AJ; Silva, MF;
Publication
2024 7TH IBERIAN ROBOTICS CONFERENCE, ROBOT 2024
Abstract
The high level of precision and consistency required for pallet detection in industrial environments and logistics tasks is a critical challenge that has been the subject of extensive research. This paper proposes a system for detecting pallets and its pockets using the You Only Look Once (YOLO) v8 Open Neural Network Exchange (ONNX) model, followed by the segmentation of the pallet surface. On the basis of the system a pipeline built on the ROS Action Server whose structure promotes modularity and ease of implementation of heuristics. Additionally, is presented a comparison between the YOLOv5 and YOLOv8 models in the detection task, trained with a customised dataset from a factory environment. The results demonstrate that the pipeline can consistently perform pallet and pocket detection, even when tested in the laboratory and with successive 3D pallet segmentation. When comparing the models, YOLOv8 achieved higher average metric values, with YOLOv8m providing better detection performance in the laboratory setting.
2024
Authors
Cordeiro, A; Rocha, LF; Boaventura Cunha, J; de Souza, JPC;
Publication
2024 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC
Abstract
Numerous pose estimation methodologies demonstrate a decrement in accuracy or efficiency metrics when subjected to highly cluttered scenarios. Currently, companies expect high-efficiency robotic systems to close the gap between humans and machines, especially in logistic operations, which is highlighted by the requirement to execute operations, such as navigation, perception and picking. To mitigate this issue, the majority of strategies augment the quantity of detected and matched features. However, in this paper, it is proposed a system which adopts an inverse strategy, for instance, it reduces the types of features detected to enhance efficiency. Upon detecting 2D polygons, this solution perceives objects, identifies their corners and edges, and establishes a relationship between the features extracted from the perceived object and the known object model. Subsequently, this relationship is used to devise a weighting system capable of predicting an optimal final pose estimation. Moreover, it has been demonstrated that this solution applies to different objects in real scenarios, such as intralogistic, and industrial, provided there is prior knowledge of the object's shape and measurements. Lastly, the proposed method was evaluated and found to achieve an average overlap rate of 89.77% and an average process time of 0.0398 seconds per object pose estimation.
2024
Authors
Lopes, MS; Silva, MF; de Souza, JPC; Costa, P;
Publication
2024 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC
Abstract
The advancement of technology has led to a growing demand for autonomy across various sectors. A key aspect of achieving autonomous navigation through intricate environments is path planning, initially confined to 2D spaces but rapidly evolving to address the complexities of 3D environments. Despite the widespread adoption of RRT-based planners, their inherent lack of optimality has encouraged researchers to find refinements. This paper transposes an existing algorithm developed for 2D environments to 3D, leveraging a heuristic to optimize the generated paths in terms of path length, memory consumed, and execution time. Along with this scalability to 3D scenarios, a modification was introduced that trades off some execution time for a substantial improvement in path length. The results obtained from a series of simulated experimental tests prove the efficacy of the proposed method in 3D environments, demonstrating reduced memory consumption and execution time compared to conventional approaches.
2016
Authors
Delgado, FS; Carvalho, JP; Coelho, TVN; Dos Santos, AB;
Publication
Sensors (Switzerland)
Abstract
In this paper, we propose and experimentally investigate an optical sensor based on a novel combination of a long-period fiber grating (LPFG) with a permanent magnet to measure electrical current in unmanned aerial vehicles (UAVs). The proposed device uses a neodymium magnet attached to the grating structure, which suffers from an electromagnetic force produced when the current flows in the wire of the UAV engine. Therefore, it causes deformation on the sensor and thus, different shifts occur in the resonant bands of the transmission spectrum of the LPFG. Finally, the results show that it is possible to monitor electrical current throughout the entire operating range of the UAV engine from 0 A to 10 A in an effective and practical way with good linearity, reliability and response time, which are desirable characteristics in electrical current sensing. © 2016 by the authors; licensee MDPI, Basel, Switzerland.
2017
Authors
Moraes, L; Carmo, LC; Campos, RF; Jucá, MA; Moreira, LS; Carvalho, JP; Texeira, AM; Silveira, DD; Coelho, TVN; Luis, A; Marcato, M; Dos Santos, AB;
Publication
IEEE Aerospace and Electronic Systems Magazine
Abstract
Surveillance missions in vast, difficult access environments are responsible for logistic difficulties in comparison to using an in loco monitoring team. For this and many other reasons, solutions with robotic platforms such as unmanned aerial vehicles (UAVs), present economic advantages. © 1986-2012 IEEE.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.