2023
Authors
Dias, J; Simoes, P; Soares, N; Costa, CM; Petry, MR; Veiga, G; Rocha, LF;
Publication
SENSORS
Abstract
Machine vision systems are widely used in assembly lines for providing sensing abilities to robots to allow them to handle dynamic environments. This paper presents a comparison of 3D sensors for evaluating which one is best suited for usage in a machine vision system for robotic fastening operations within an automotive assembly line. The perception system is necessary for taking into account the position uncertainty that arises from the vehicles being transported in an aerial conveyor. Three sensors with different working principles were compared, namely laser triangulation (SICK TriSpector1030), structured light with sequential stripe patterns (Photoneo PhoXi S) and structured light with infrared speckle pattern (Asus Xtion Pro Live). The accuracy of the sensors was measured by computing the root mean square error (RMSE) of the point cloud registrations between their scans and two types of reference point clouds, namely, CAD files and 3D sensor scans. Overall, the RMSE was lower when using sensor scans, with the SICK TriSpector1030 achieving the best results (0.25 mm +/- 0.03 mm), the Photoneo PhoXi S having the intermediate performance (0.49 mm +/- 0.14 mm) and the Asus Xtion Pro Live obtaining the higher RMSE (1.01 mm +/- 0.11 mm). Considering the use case requirements, the final machine vision system relied on the SICK TriSpector1030 sensor and was integrated with a collaborative robot, which was successfully deployed in an vehicle assembly line, achieving 94% success in 53,400 screwing operations.
2023
Authors
Moutinho, D; Rocha, LF; Costa, CM; Teixeira, LF; Veiga, G;
Publication
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING
Abstract
Human-Robot Collaboration is a critical component of Industry 4.0, contributing to a transition towards more flexible production systems that are quickly adjustable to changing production requirements. This paper aims to increase the natural collaboration level of a robotic engine assembly station by proposing a cognitive system powered by computer vision and deep learning to interpret implicit communication cues of the operator. The proposed system, which is based on a residual convolutional neural network with 34 layers and a long -short term memory recurrent neural network (ResNet-34 + LSTM), obtains assembly context through action recognition of the tasks performed by the operator. The assembly context was then integrated in a collaborative assembly plan capable of autonomously commanding the robot tasks. The proposed model showed a great performance, achieving an accuracy of 96.65% and a temporal mean intersection over union (mIoU) of 94.11% for the action recognition of the considered assembly. Moreover, a task-oriented evaluation showed that the proposed cognitive system was able to leverage the performed human action recognition to command the adequate robot actions with near-perfect accuracy. As such, the proposed system was considered as successful at increasing the natural collaboration level of the considered assembly station.
2026
Authors
Nascimento, RC; Martins, JG; Gonzalez, DG; Silva, MF; Filipe, V; Petry, MR; Rocha, LF;
Publication
ICARA
Abstract
Inspecting reflective parts is challenging due to strong specular reflections that conceal small porosities and reduce defect visibility. This work presents a framework that combines augmented reality with a deep learning detector. An augmented reality headset is used to capture multi-view images under natural illumination, enabling the operator to adjust the viewpoint and obtain angles that reduce glare. The collected data form a 640 × 480 dataset used to train a yolov8 detection model, integrated into a Robot Operating System 2 architecture for real-time processing. Testing on an independent set of unseen parts yields a precision of 86.70 %, a recall of 87.26 %, and an F1-score of 86.97 %. Additional qualitative examples confirm that the model can identify low-contrast porosities despite reflective surfaces. The results demonstrate the feasibility of AR-assisted acquisition combined with deep learning for real-time inspection of machined aluminum components in a laboratory case study. © 2026 IEEE.
2026
Authors
Lopes, D; Pires, EJS; Filipe, V; Silva, MF; Rocha, LF;
Publication
TECHNOLOGIES
Abstract
Textile-to-textile recycling is strongly constrained by upstream pre-processing, where post-consumer clothing must be identified, separated, and prepared under high variability in materials, appearance, and contamination. This paper presents a Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)-guided systematic literature review of intelligent and automated technologies for textile recycling pre-processing covering the interval between 2015 to 2025. After screening and quality assessment, 21 primary studies published between 2020 and 2025 were included. The literature is synthesized across three task families: (i) identificationof fiber/material, composition, or color; (ii) sorting, considered only when explicit separation strategies are defined to operationalize identification outcomes into routing actions or output streams; and (iii) contaminant detection and/or removal, targeting non-recyclable items. Results show that identification dominates the field (19/21 studies), supported by Red-Green-Blue (RGB) and red-green-blue plus depth (RGB-D) imaging and material-signature sensing, including near-infrared (NIR) spectroscopy, hyperspectral imaging (HSI), and Raman spectroscopy. In contrast, sorting as a defined separation stage is less frequent (4/21), and contaminant-related automation remains sparse (3/21). Most studies are validated in laboratory conditions, with limited semi-industrial evidence, highlighting a persistent perception-to-action gap. Overall, the review indicates that robust separation strategies, representative datasets, and end-to-end system integration remain key bottlenecks for scalable automated textile recycling pre-processing.
2026
Authors
de Souza, JPC; Rocha, LF; Moreira, AP; Boaventura Cunha, J;
Publication
JOURNAL OF FIELD ROBOTICS
Abstract
The Industry 5.0 concept guides the industry to the premise of sustainability, resilience and human-centric solutions. The last related pillar tries to create solutions to empower the people in production line processes since solutions should be designed to be easy to use and easy to learn without discarding the working people. In this regard, it's natural that robots become closer to humans in industrial applications where it is possible to absorb human-machine qualities. Robotic grasping has widespread application with a wide range of applicability. However, engineers and shop-floor operators spend time finding a fast response solution when the production demand changes. Aiming to create a tool to help this procedure in a human-centred fashion, the current paper proposes a programming-by-demonstration solution that is easy to use, reuse, adapt, and increment with its modular design.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.