Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
About

About

Electrical engineering formation with an emphasis on electronic systems and a master's in electrical engineering from the Federal University of Juiz de Fora, his training allowed him to have competence in the area of digital and analog electronics. However, the central area of expertise is robotics in which he is since 2012 as a researcher and promoted his master's degree. He is currently R&D and develops research in the robotics area at the Institute of Systems and Computer Engineering, Technology and Science - INESC TEC. He has experience in several R&D projects that he developed in Brazil and Portugal. Expertise areas, experience, and skills include the creation of firmware, middleware and software, embedded systems, control techniques, and artificial and computational intelligence. Development of robots, autonomous unmanned aerial vehicles, autonomous systems, robotic manipulators, industrial robotics, and sensing (computer vision and 3D perception).

Interest
Topics
Details

Details

  • Name

    João Pedro Souza
  • Role

    Assistant Researcher
  • Since

    21st May 2018
012
Publications

2026

A review of visual perception for robotic bin-picking

Authors
Cordeiro, A; Rocha, LF; Boaventura-Cunha, J; Figueiredo, D; Souza, JP;

Publication
ROBOTICS AND AUTONOMOUS SYSTEMS

Abstract
Robotic bin-picking is a critical operation in modern industry, which is characterised by the detection, selection, and placement of items from a disordered and cluttered environment, which can be boundary limited or not, e.g. bins, boxes or containers. In this context, perception systems are employed to localise, detect and estimate grasping points. Despite the considerable progress made, from analytical approaches to recent deep learning methods, challenges still remain. This is evidenced by the growing innovation proposing distinct solutions. This paper aims to review perception methodologies developed since 2009, providing detailed descriptions and discussions of their implementation. Additionally, it presents an extensive study, detailing each work, along with a comprehensive overview of the advancements in bin-picking perception.

2025

Robot Path Planning: from Analytical to Computer Intelligence Approaches

Authors
Dias, PA; de Souza, JPC; Pires, EJS; Filipe, V; Figueiredo, D; Rocha, LF; Silva, MF;

Publication
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS

Abstract
In an era where robots are becoming an integral part of human quotidian activities, understanding how they function is crucial. Among the inherent building complexities, from electronics to mechanics, path planning emerges as a universal aspect of robotics. The primary contribution of this work is to provide an overview of the current state of robot path planning topics and a comparison between those same algorithms and its inherent characteristics. The path planning concept relies on the process by which an algorithm determines a collision-free path between a start and an end point, optimizing parameters such as energy consumption and distance. The quest for the most effective path planning method has been a long-standing discussion, as the choice of method is highly dependent on the specific application. This review consolidates and elucidates the categories of path planning methods, specifically classical or analytical methods, and computer intelligence methods. In addition, the operational principles of these categories will be explored, discussing their respective advantages and disadvantages, and reinforcing these discussions with relevant studies in the field. This work will focus on the most prevalent and recognized methods within the robotics path planning problem, being mobile robotics or manipulator arms, including Cell Decomposition, A*, Probabilistic Roadmaps, Rapidly-exploring Random Trees, Genetic Algorithms, Particle Swarm Optimization, Ant Colony Optimization, Artificial Potential Fields, Fuzzy, and Neural Networks. Following the detailed explanation of these methods, a comparative analysis of their advantages and drawbacks is organized in a comprehensive table. This comparison will be based on various quality metrics, such as the type of trajectory provided (global or local), the scenario implementation type (real or simulated scenarios), testing environments (static or dynamic), hybrid implementation possibilities, real-time implementation, completeness of the method, consideration of the robot's kinodynamic constraints, use of smoothing techniques, and whether the implementation is online or offline.

2025

Friday: The Versatile Mobile Manipulator Robot

Authors
de Souza, JPC; Cordeiro, AJ; Dias, PA; Rocha, LF;

Publication
EUROPEAN ROBOTICS FORUM 2025

Abstract
This article introduces Friday, a Mobile Manipulator (MoMa) solution designed at iiLab - INESC TEC. Friday is versatile and applicable in various contexts, including warehouses, naval shipyards, aerospace industries, and production lines. The robot features an omnidirectional platform, multiple grippers, and sensors for localisation, safety, and object detection. Its modular hardware and software system enhances functionality across different industrial scenarios. The system provides a stable platform supporting scientific advancements and meeting modern industry demands, with results verified in the aerospace, automotive, naval, and logistics.

2025

Object segmentation dataset generation framework for robotic bin-picking: Multi-metric analysis between results trained with real and synthetic data

Authors
Cordeiro, A; Rocha, LF; Boaventura-Cunha, J; Pires, EJS; Souza, JP;

Publication
COMPUTERS & INDUSTRIAL ENGINEERING

Abstract
The implementation of deep learning approaches based on instance segmentation data remains a challenge for customized scenarios, owing to the time-consuming nature of acquiring and annotating real-world instance segmentation data, which requires a significant investment of semi-professional user labour. Obtaining high-quality labelled data demands expertise and meticulous attention to detail. This requirement can significantly impact the overall implementation process, adding to the complexity and resource requirements of customized scenarios with diverse objects. The proposed work addresses the challenge of generating labelled data for large-scale robotic bin-picking datasets by proposing an easy-to-use automated framework designed to create customized data with accurate labels from CAD models. The framework leverages a photorealistic rendering engine integrated with physics simulation, minimizing the gap between synthetic and real-world data. Models trained using the synthetic data generated by this framework achieved an Average Precision of 86.95%, comparable to the performance of models trained on real-world datasets. Furthermore, this paper provides a comprehensive multi-metric analysis across diverse objects representing distinct industrial applications, including naval, logistics, and aerospace domains. The evaluation also includes the use of three distinct instance segmentation networks, alongside a comparative analysis of the proposed approach against two generative model techniques.

2024

A ROS-Based Modular Action Server for Efficient Motion Planning in Robotic Manipulators

Authors
Dias, PA; Souza, JC; Rocha, LE; Figueiredo, D; Silva, MF;

Publication
2024 7TH IBERIAN ROBOTICS CONFERENCE, ROBOT 2024

Abstract
This paper discusses the emerging field of robotics, particularly focusing on motion planning for robotic manipulators. It highlights the need for simplification and standardization in robot implementation processes. Among several tools available, the paper focuses on the MoveIt tool due to its compatibility, popularity, and community contributions. However, the paper acknowledges some resistance in developing new applications with MoveIt, especially for researchers and beginners. To address this, the paper introduces an efficient, modular action server for interacting with the MoveIt framework. This pipeline simplifies parameter reconfiguration and provides a general solution for the motion planning problem. It can calculate trajectories for robotic manipulators without environmental collisions using a single server request and supports operation in different modes. The server was tested on an Universal Robots UR10 manipulator, demonstrating its ability to quickly plan paths for two test operations: an object pick-and-place mission and a collision avoidance test. The results were positive, achieving the set goals with minimal user-server interaction. This work represents a significant step towards more efficient and user-friendly robotic manipulation.