Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
About

About

Luis Rocha received his Ph.D. in Electrical and Computer Engineering from the Faculty of Engineering University of Porto in 2014. He has been a researcher at INESC TEC since 2010, and he currently oversees the industrial manipulator research area at the Center for Robotics in Industry and Intelligent Systems (CRIIS). Member of the iilab executive committee (Industry and Innovation Lab of INESC TEC), in charge of the lab's infrastructure. Supervisor of several Master's and PhD theses. He has over 50 publications in international scientific journals and conference proceedings, and he is now an Associate Editor for the Industrial Robot Journal. His primary research interests include developing agile and human-centered industrial robotic systems, as well as investigating novel human-robot interaction solutions, robot programming procedures, and advanced perception and manipulation systems. He led the INESC team on a number of national and European R&D projects. Luís has 5 years of experience as an entrepreneur (robotics startup).

Details

Details

  • Name

    Luís Freitas Rocha
  • Role

    Centre Coordinator
  • Since

    01st September 2010
042
Publications

2024

Inspection of Part Placement Within Containers Using Point Cloud Overlap Analysis for an Automotive Production Line

Authors
Costa C.M.; Dias J.; Nascimento R.; Rocha C.; Veiga G.; Sousa A.; Thomas U.; Rocha L.;

Publication
Lecture Notes in Mechanical Engineering

Abstract
Reliable operation of production lines without unscheduled disruptions is of paramount importance for ensuring the proper operation of automated working cells involving robotic systems. This article addresses the issue of preventing disruptions to an automotive production line that can arise from incorrect placement of aluminum car parts by a human operator in a feeding container with 4 indexing pins for each part. The detection of the misplaced parts is critical for avoiding collisions between the containers and a high pressure washing machine and also to avoid collisions between the parts and a robotic arm that is feeding parts to a air leakage inspection machine. The proposed inspection system relies on a 3D sensor for scanning the parts inside a container and then estimates the 6 DoF pose of the container followed by an analysis of the overlap percentage between each part reference point cloud and the 3D sensor data. When the overlap percentage is below a given threshold, the part is considered as misplaced and the operator is alerted to fix the part placement in the container. The deployment of the inspection system on an automotive production line for 22 weeks has shown promising results by avoiding 18 hours of disruptions, since it detected 407 containers having misplaced parts in 4524 inspections, from which 12 were false negatives, while no false positives were reported, which allowed the elimination of disruptions to the production line at the cost of manual reinspection of 0.27% of false negative containers by the operator.

2024

Automating Lateral Shoe Roughing through a Robotic Manipulator Programmed by Demonstration

Authors
Ventuzelos V.; Petry M.R.; Rocha L.F.;

Publication
2024 IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2024

Abstract
The footwear industry is known for its longstanding traditional production methods that require intense manual labor. Roughing, for example, is regarded as one of the significant and critical operations in shoe manufacturing and consists of using abrasive tools to remove a thin layer of the shoe's surface, creating a slightly roughened texture that provides a better surface area for adhesion. As such, workers are typically subjected to hazardous substances (i.e., dust, chromium), repetitive strain injuries, and ergonomic challenges. Although robots can automate repetitive tasks and perform with high precision and consistency, the footwear industry is usually reluctant to employ industrial robots due to the need for restructuring. This paper addresses the challenge of re-designing the lateral roughing of uppers to allow robot-assisted manufacturing with minimal modifications in the manufacturing process. The proposed innovative system employs a robotic manipulator to perform roughing based on data collected from preceding manufacturing steps. Workers marking the mesh line of each sole-upper pair can simultaneously teach the manipulator path for that same pair, using a programming-by-demonstration approach. Multiple paths were collected by outlining a piece of footwear, converted into robot instructions, and deployed on a simulated and real industrial manipulator. The key findings of this research showcase the capability of the proposed solution to replicate collected paths accurately, indicating potential applications not only in roughing processes but also in similar tasks like primer and adhesive application.

2024

6D pose estimation for objects based on polygons in cluttered and densely occluded environments

Authors
Cordeiro A.; Rocha L.F.; Boaventura-Cunha J.; De Souza J.P.C.;

Publication
2024 IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2024

Abstract
Numerous pose estimation methodologies demonstrate a decrement in accuracy or efficiency metrics when subjected to highly cluttered scenarios. Currently, companies expect high-efficiency robotic systems to close the gap between humans and machines, especially in logistic operations, which is highlighted by the requirement to execute operations, such as navigation, perception and picking. To mitigate this issue, the majority of strategies augment the quantity of detected and matched features. However, in this paper, it is proposed a system which adopts an inverse strategy, for instance, it reduces the types of features detected to enhance efficiency. Upon detecting 2D polygons, this solution perceives objects, identifies their corners and edges, and establishes a relationship between the features extracted from the perceived object and the known object model. Subsequently, this relationship is used to devise a weighting system capable of predicting an optimal final pose estimation. Moreover, it has been demonstrated that this solution applies to different objects in real scenarios, such as intralogistic, and industrial, provided there is prior knowledge of the object's shape and measurements. Lastly, the proposed method was evaluated and found to achieve an average overlap rate of 89.77% and an average process time of 0.0398 seconds per object pose estimation.

2023

Object Segmentation for Bin Picking Using Deep Learning

Authors
Cordeiro, A; Rocha, LF; Costa, C; Silva, MF;

Publication
ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 2

Abstract
Bin picking based on deep learning techniques is a promising approach that can solve several analytical methods problems. These systems can provide accurate solutions to bin picking in cluttered environments, where the scenario is always changing. This article proposes a robust and accurate system for segmenting bin picking objects, employing an easy configuration procedure to adjust the framework according to a specific object. The framework is implemented in Robot Operating System (ROS) and is divided into a detection and segmentation system. The detection system employs Mask R-CNN instance neural network to identify several objects from two dimensions (2D) grayscale images. The segmentation system relies on the point cloud library (PCL), manipulating 3D point cloud data according to the detection results to select particular points of the original point cloud, generating a partial point cloud result. Furthermore, to complete the bin picking system a pose estimation approach based on matching algorithms is employed, such as Iterative Closest Point (ICP). The system was evaluated for two types of objects, knee tube, and triangular wall support, in cluttered environments. It displayed an average precision of 79% for both models, an average recall of 92%, and an average IOU of 89%. As exhibited throughout the article, this system demonstrates high accuracy in cluttered environments with several occlusions for different types of objects.

2023

Bin Picking for Ship-Building Logistics Using Perception and Grasping Systems

Authors
Cordeiro, A; Souza, JP; Costa, CM; Filipe, V; Rocha, LF; Silva, MF;

Publication
ROBOTICS

Abstract
Bin picking is a challenging task involving many research domains within the perception and grasping fields, for which there are no perfect and reliable solutions available that are applicable to a wide range of unstructured and cluttered environments present in industrial factories and logistics centers. This paper contributes with research on the topic of object segmentation in cluttered scenarios, independent of previous object shape knowledge, for textured and textureless objects. In addition, it addresses the demand for extended datasets in deep learning tasks with realistic data. We propose a solution using a Mask R-CNN for 2D object segmentation, trained with real data acquired from a RGB-D sensor and synthetic data generated in Blender, combined with 3D point-cloud segmentation to extract a segmented point cloud belonging to a single object from the bin. Next, it is employed a re-configurable pipeline for 6-DoF object pose estimation, followed by a grasp planner to select a feasible grasp pose. The experimental results show that the object segmentation approach is efficient and accurate in cluttered scenarios with several occlusions. The neural network model was trained with both real and simulated data, enhancing the success rate from the previous classical segmentation, displaying an overall grasping success rate of 87.5%.

Supervised
thesis

2023

Automated Shoe Roughing Cell

Author
David José Lucas Raposo

Institution
UP-FEUP

2022

Selecting fast-moving consumer goods product lines

Author
Xavier António Reis Andrade

Institution
UP-FEUP

2022

Analysis of energy policies: multidisciplinary, data driven tool

Author
Dania Carolina Ortiz Acosta

Institution
UP-FEUP

2017

"em definição"

Author
Orlanda Filipa Jacinto e Simas

Institution
UP-FEUP