Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu


  • Name

    Rui Pedro Nascimento
  • Role

    Research Assistant
  • Since

    01st September 2022


Inspection of Part Placement Within Containers Using Point Cloud Overlap Analysis for an Automotive Production Line

Costa, M; Dias, J; Nascimento, R; Rocha, C; Veiga, G; Sousa, A; Thomas, U; Rocha, L;

Lecture Notes in Mechanical Engineering

Reliable operation of production lines without unscheduled disruptions is of paramount importance for ensuring the proper operation of automated working cells involving robotic systems. This article addresses the issue of preventing disruptions to an automotive production line that can arise from incorrect placement of aluminum car parts by a human operator in a feeding container with 4 indexing pins for each part. The detection of the misplaced parts is critical for avoiding collisions between the containers and a high pressure washing machine and also to avoid collisions between the parts and a robotic arm that is feeding parts to a air leakage inspection machine. The proposed inspection system relies on a 3D sensor for scanning the parts inside a container and then estimates the 6 DoF pose of the container followed by an analysis of the overlap percentage between each part reference point cloud and the 3D sensor data. When the overlap percentage is below a given threshold, the part is considered as misplaced and the operator is alerted to fix the part placement in the container. The deployment of the inspection system on an automotive production line for 22 weeks has shown promising results by avoiding 18 hours of disruptions, since it detected 407 containers having misplaced parts in 4524 inspections, from which 12 were false negatives, while no false positives were reported, which allowed the elimination of disruptions to the production line at the cost of manual reinspection of 0.27% of false negative containers by the operator. © 2024, The Author(s), under exclusive license to Springer Nature Switzerland AG.


Quality Control of Casting Aluminum Parts: A Comparison of Deep Learning Models for Filings Detection

Nascimento, R; Ferreira, T; Rocha, C; Filipe, V; Silva, MF; Veiga, G; Rocha, L;


Quality control inspection systems are crucial and a key factor in maintaining and ensuring the integrity of any product. The quality inspection task is a repetitive task, when performed by operators only, it can be slow and susceptible to failures due to the lack of attention and fatigue. This work focuses on the inspection of parts made of high-pressure diecast aluminum for components of the automotive industry. In the present case study, last year, 18240 parts needed to be reinspected, requiring approximately 96 hours, a time that could be spent on other tasks. This article performs a comparison of four deep learning models: Faster R-CNN, RetinaNet, YOLOv7, and YOLOv7-tiny, to find out which one is more suited to perform the quality inspection task of detecting metal filings on casting aluminum parts. As for this use-case the prototype must be highly intolerant to False Negatives, that is, the part being defective and passing undetected, Faster R-CNN was considered the bestperforming model based on a Recall value of 96.00%.


Computer Vision Based Quality Control for Additive Manufacturing Parts

Nascimento, R; Martins, I; Dutra, TA; Moreira, L;


This work presents a novel methodology for the quality assessment of material extrusion parts through AI-based Computer Vision. To this end, different techniques are integrated using inspection methods that are applied to other areas in additive manufacturing field. The system is divided into four main points: (1) pre-processing, (2) color analysis, (3) shape analysis, and (4) defect location. The color analysis is performed in CIELAB color space, and the color distance between the part under analysis and the reference surface is calculated using the color difference formula CIE2000. The shape analysis consists of the binarization of the image using the Canny edge detector. Then, the Hu moments are calculated for images from the part under analysis and the results are compared with those from the reference part. To locate defects, the image of the part to be analyzed is first processed with a median filter, and both the original and filtered image are subtracted. Then, the resulting image is binarized, and the defects are located through a blob detector. In the training phase, a subset of parts was used to evaluate the performance of different methods and to set the values of parameters. Later, in a testing and validation phase, the performance of the system was evaluated using a different set of parts. The results show that the proposed system is able to classify parts produced by additive manufacturing, with an overall accuracy of 86.5%, and to locate defects on their surfaces in a more effective manner.