Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por CRIIS

2025

Automated optical system for quality inspection on reflective parts

Autores
Nascimento, R; Rocha, CD; Gonzalez, DG; Silva, T; Moreira, R; Silva, MF; Filipe, V; Rocha, LF;

Publicação
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY

Abstract
The growing demand for high-quality components in various industries, particularly in the automotive sector, requires advanced and reliable inspection methods to maintain competitive standards and support innovation. Manual quality inspection tasks are often inefficient and prone to errors due to their repetitive nature and subjectivity, which can lead to attention lapses and operator fatigue. The inspection of reflective aluminum parts presents additional challenges, as uncontrolled reflections and glare can obscure defects and reduce the reliability of conventional vision-based methods. Addressing these challenges requires optimized illumination strategies and robust image processing techniques to enhance defect visibility. This work presents the development of an automated optical inspection system for reflective parts, focusing on components made of high-pressure diecast aluminum used in the automotive industry. The reflective nature of these parts introduces challenges for defect detection, requiring optimized illumination and imaging methods. The system applies deep learning algorithms and uses dome light to achieve uniform illumination, enabling the detection of small defects on reflective surfaces. A collaborative robotic manipulator equipped with a gripper handles the parts during inspection, ensuring precise positioning and repeatability, which improves both the efficiency and effectiveness of the inspection process. A flow execution-based software platform integrates all system components, enabling seamless operation. The system was evaluated with Schmidt Light Metal Group using three custom datasets to detect surface porosities and inner wall defects post-machining. For surface porosity detection, YOLOv8-Mosaic, trained with cropped images to reduce background noise, achieved a recall value of 84.71% and was selected for implementation. Additionally, an endoscopic camera was used in a preliminary study to detect defects within the inner walls of holes. The industrial trials produced promising results, demonstrating the feasibility of implementing a vision-based automated inspection system in various industries. The system improves inspection accuracy and efficiency while reducing material waste and operator fatigue.

2025

Methodology and Challenges of Implementing Advanced Technological Solutions in Small and Medium Shipyards: The Case Study of the Mari4_YARD Project

Autores
Grazi, L; Feijoo Alonso, A; Gasiorek, A; Pertusa Llopis, AM; Grajeda, A; Kanakis, A; Rodriguez Vidal, A; Parri, A; Vidal, F; Ergas, I; Zeljkovic, I; Durá, JP; Mein, JP; Katsampiris-Salgado, K; Rocha, LF; Rodriguez, LN; Petry, MR; Neufeld, M; Dimitropoulos, N; Köster, N; Mimica, R; Fernandes, SV; Crea, S; Makris, S; Giartzas, S; Settler, V; Masood, J;

Publicação
Electronics

Abstract
Small to medium-sized shipyards play a crucial role in the European naval industry. However, the globalization of technology has increased competition, posing significant challenges to shipyards, particularly in domestic markets for short sea, work, and inland vessels. Many shipyard operations still rely on manual, labor-intensive tasks performed by highly skilled operators. In response, the adoption of new tools is essential to enhance efficiency and competitiveness. This paper presents a methodology for developing a human-centric portfolio of advanced technologies tailored for shipyard environments, covering processes such as shipbuilding, retrofitting, outfitting, and maintenance. The proposed technological solutions, which have achieved high technology readiness levels, include 3D modeling and digitalization, robotics, augmented and virtual reality, and occupational exoskeletons. Key findings from real-scale demonstrations are discussed, along with major development and implementation challenges. Finally, best practices and recommendations are provided to support both technology developers seeking fully tested tools and end users aiming for seamless adoption.

2025

Quality Inspection in Casting Aluminum Parts: A Machine Vision System for Filings Detection and Hole Inspection

Autores
Nascimento, R; Ferreira, T; Rocha, CD; Filipe, V; Silva, MF; Veiga, G; Rocha, L;

Publicação
Journal of Intelligent & Robotic Systems

Abstract
Abstract Quality inspection inspection systems are critical for maintaining product integrity. Being a repetitive task, when performed by operators only, it can be slow and error-prone. This paper introduces an automated inspection system for quality assessment in casting aluminum parts resorting to a robotic system. The method comprises two processes: filing detection and hole inspection. For filing detection, five deep learning modes were trained. These models include an object detector and four instance segmentation models: YOLOv8, YOLOv8n-seg, YOLOv8s-seg, YOLOv8m-seg, and Mask R-CNN, respectively. Among these, YOLOv8s-seg exhibited the best overall performance, achieving a recall rate of 98.10%, critical for minimizing false negatives and yielding the best overall results. Alongside, the system inspects holes, utilizing image processing techniques like template-matching and blob detection, achieving a 97.30% accuracy and a 2.67% Percentage of Wrong Classifications. The system improves inspection precision and efficiency while supporting sustainability and ergonomic standards, reducing material waste and reducing operator fatigue.

2025

Object segmentation dataset generation framework for robotic bin-picking: Multi-metric analysis between results trained with real and synthetic data

Autores
Cordeiro, A; Rocha, LF; Boaventura-Cunha, J; Pires, EJS; Souza, JP;

Publicação
Computers & Industrial Engineering

Abstract

2025

Pollinationbots - A Swarm Robotic System for Tree Pollination

Autores
Castro, JT; Pinheiro, I; Marques, MN; Moura, P; dos Santos, FN;

Publicação
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Abstract
In nature, and particularly in agriculture, pollination is fundamental for the sustainability of our society. In this context, pollination is a vital process underlying crop yield quality and is responsible for the biodiversity and the standards of the flora. Bees play a crucial role in natural pollination; however, their populations are declining. Robots can help maintain pollination levels while humans work to recover bee populations. Swarm robotics approaches appear promising for robotic pollination. This paper proposes the cooperation between multiple Unmanned Aerial Vehicles (UAVs) and an Unmanned Ground Vehicle (UGV), leveraging the advantages of collaborative work for pollination, referred to as Pollinationbots. Pollinationbots is based in swarm behaviors and methodologies to implement more effective pollination strategies, ensuring efficient pollination across various scenarios. The paper presents the architecture of the Pollinationbots system, which was evaluated using the Webots simulator, focusing on path planning and follower behavior. Preliminary simulation results indicate that this is a viable solution for robotic pollination. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

2025

Grapevine inflorescence segmentation and flower estimation based on Computer Vision techniques for early yield assessment

Autores
Moreira, G; dos Santos, FN; Cunha, M;

Publicação
SMART AGRICULTURAL TECHNOLOGY

Abstract
Yield forecasting is of immeasurable value in modern viticulture to optimize harvest scheduling and quality management. The number of inflorescences and flowers per vine is one of the main components and their assessment serves as an early predictor, which can explain up to 85-90% of yield variability. This study introduces a sophisticated framework that integrates the benchmark of different advanced deep learning and classic image processing to automate the segmentation of grapevine inflorescences and the detection of single flowers, to achieve precise, early, and non-invasive yield predictions in viticulture. The YOLOv8n model achieved superior performance in localizing inflorescences ( F1-Score (Box) = 95.9%) and detecting individual flowers (F1-Score = 91.4%), while the YOLOv5n model excelled in the segmentation task ( F1-Score (Mask) = 98.6%). The models demonstrated a strong correlation (R-2 > 90.0%) between detected and visible flowers in inflorescences. A statistical analysis confirmed the robustness of the framework, with the YOLOv8 model once again standing out, showing no significant differences in error rates across diverse grapevine morphologies and varieties, ensuring wide applicability. The results demonstrate that these models can significantly improve the accuracy of early yield predictions, offering a noninvasive, scalable solution for Precision Viticulture. The findings underscore the potential for Computer Vision technology to enhance vineyard management practices, leading to better resource allocation and improved crop quality.

  • 2
  • 360