Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por João Pedro Souza

2021

Low-Cost and Reduced-Size 3D-Cameras Metrological Evaluation Applied to Industrial Robotic Welding Operations

Autores
de Souza, JPC; Rocha, LF; Filipe, VM; Boaventura Cunha, J; Moreira, AP;

Publicação
2021 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC)

Abstract
Nowadays, the robotic welding joint estimation, or weld seam tracking, has improved according to the new developments on computer vision technologies. Typically, the advances are focused on solving inaccurate procedures that advent from the manual positioning of the metal parts in welding workstations, especially in SMEs. Robotic arms, endowed with the appropriate perception capabilities, are a viable solution in this context, aiming for enhancing the production system agility whilst not increasing the production set-up time and costs. In this regard, this paper proposes a local perception pipeline to estimate joint welding points using small-sized/low-cost 3D cameras, following an eyes-on-hand approach. A metrological 3D camera comparison between Intel Realsene D435, D415, and ZED Mini is also discussed, proving that the proposed pipeline associated with standard commercial 3D cameras is viable for welding operations in an industrial environment.

2022

Industrial robot programming by demonstration using stereoscopic vision and inertial sensing

Autores
de Souza, JPC; Amorim, AM; Rocha, LF; Pinto, VH; Moreira, AP;

Publicação
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION

Abstract
Purpose The purpose of this paper is to present a programming by demonstration (PbD) system based on 3D stereoscopic vision and inertial sensing that provides a cost-effective pose tracking system, even during error-prone situations, such as camera occlusions. Design/methodology/approach The proposed PbD system is based on the 6D Mimic innovative solution, whose six degrees of freedom marker hardware had to be revised and restructured to accommodate an IMU sensor. Additionally, a new software pipeline was designed to include this new sensing device, seeking the improvement of the overall system's robustness in stereoscopic vision occlusion situations. Findings The IMU component and the new software pipeline allow the 6D Mimic system to successfully maintain the pose tracking when the main tracking tool, i.e. the stereoscopic vision, fails. Therefore, the system improves in terms of reliability, robustness, and accuracy which were verified by real experiments. Practical implications Based on this proposal, the 6D Mimic system reaches a reliable and low-cost PbD methodology. Therefore, the robot can accurately replicate, on an industrial scale, the artisan level performance of highly skilled shop-floor operators. Originality/value To the best of the authors' knowledge, the sensor fusion between stereoscopic images and IMU applied to robot PbD is a novel approach. The system is entirely designed aiming to reduce costs and taking advantage of an offline processing step for data analysis, filtering and fusion, enhancing the reliability of the PbD system.

2025

Robot Path Planning: from Analytical to Computer Intelligence Approaches

Autores
Dias, PA; de Souza, JPC; Pires, EJS; Filipe, V; Figueiredo, D; Rocha, LF; Silva, MF;

Publicação
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS

Abstract
In an era where robots are becoming an integral part of human quotidian activities, understanding how they function is crucial. Among the inherent building complexities, from electronics to mechanics, path planning emerges as a universal aspect of robotics. The primary contribution of this work is to provide an overview of the current state of robot path planning topics and a comparison between those same algorithms and its inherent characteristics. The path planning concept relies on the process by which an algorithm determines a collision-free path between a start and an end point, optimizing parameters such as energy consumption and distance. The quest for the most effective path planning method has been a long-standing discussion, as the choice of method is highly dependent on the specific application. This review consolidates and elucidates the categories of path planning methods, specifically classical or analytical methods, and computer intelligence methods. In addition, the operational principles of these categories will be explored, discussing their respective advantages and disadvantages, and reinforcing these discussions with relevant studies in the field. This work will focus on the most prevalent and recognized methods within the robotics path planning problem, being mobile robotics or manipulator arms, including Cell Decomposition, A*, Probabilistic Roadmaps, Rapidly-exploring Random Trees, Genetic Algorithms, Particle Swarm Optimization, Ant Colony Optimization, Artificial Potential Fields, Fuzzy, and Neural Networks. Following the detailed explanation of these methods, a comparative analysis of their advantages and drawbacks is organized in a comprehensive table. This comparison will be based on various quality metrics, such as the type of trajectory provided (global or local), the scenario implementation type (real or simulated scenarios), testing environments (static or dynamic), hybrid implementation possibilities, real-time implementation, completeness of the method, consideration of the robot's kinodynamic constraints, use of smoothing techniques, and whether the implementation is online or offline.

2026

A review of visual perception for robotic bin-picking

Autores
Cordeiro, A; Rocha, LF; Boaventura-Cunha, J; Figueiredo, D; Souza, JP;

Publicação
ROBOTICS AND AUTONOMOUS SYSTEMS

Abstract
Robotic bin-picking is a critical operation in modern industry, which is characterised by the detection, selection, and placement of items from a disordered and cluttered environment, which can be boundary limited or not, e.g. bins, boxes or containers. In this context, perception systems are employed to localise, detect and estimate grasping points. Despite the considerable progress made, from analytical approaches to recent deep learning methods, challenges still remain. This is evidenced by the growing innovation proposing distinct solutions. This paper aims to review perception methodologies developed since 2009, providing detailed descriptions and discussions of their implementation. Additionally, it presents an extensive study, detailing each work, along with a comprehensive overview of the advancements in bin-picking perception.

2024

A ROS-Based Modular Action Server for Efficient Motion Planning in Robotic Manipulators

Autores
Dias, PA; Souza, JC; Rocha, LE; Figueiredo, D; Silva, MF;

Publicação
2024 7TH IBERIAN ROBOTICS CONFERENCE, ROBOT 2024

Abstract
This paper discusses the emerging field of robotics, particularly focusing on motion planning for robotic manipulators. It highlights the need for simplification and standardization in robot implementation processes. Among several tools available, the paper focuses on the MoveIt tool due to its compatibility, popularity, and community contributions. However, the paper acknowledges some resistance in developing new applications with MoveIt, especially for researchers and beginners. To address this, the paper introduces an efficient, modular action server for interacting with the MoveIt framework. This pipeline simplifies parameter reconfiguration and provides a general solution for the motion planning problem. It can calculate trajectories for robotic manipulators without environmental collisions using a single server request and supports operation in different modes. The server was tested on an Universal Robots UR10 manipulator, demonstrating its ability to quickly plan paths for two test operations: an object pick-and-place mission and a collision avoidance test. The results were positive, achieving the set goals with minimal user-server interaction. This work represents a significant step towards more efficient and user-friendly robotic manipulation.

2025

Friday: The Versatile Mobile Manipulator Robot

Autores
de Souza, JPC; Cordeiro, AJ; Dias, PA; Rocha, LF;

Publicação
EUROPEAN ROBOTICS FORUM 2025

Abstract
This article introduces Friday, a Mobile Manipulator (MoMa) solution designed at iiLab - INESC TEC. Friday is versatile and applicable in various contexts, including warehouses, naval shipyards, aerospace industries, and production lines. The robot features an omnidirectional platform, multiple grippers, and sensors for localisation, safety, and object detection. Its modular hardware and software system enhances functionality across different industrial scenarios. The system provides a stable platform supporting scientific advancements and meeting modern industry demands, with results verified in the aerospace, automotive, naval, and logistics.

  • 3
  • 5