Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por João Pedro Souza

2021

Low-Cost and Reduced-Size 3D-Cameras Metrological Evaluation Applied to Industrial Robotic Welding Operations

Autores
de Souza, JPC; Rocha, LF; Filipe, VM; Boaventura Cunha, J; Moreira, AP;

Publicação
2021 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC)

Abstract
Nowadays, the robotic welding joint estimation, or weld seam tracking, has improved according to the new developments on computer vision technologies. Typically, the advances are focused on solving inaccurate procedures that advent from the manual positioning of the metal parts in welding workstations, especially in SMEs. Robotic arms, endowed with the appropriate perception capabilities, are a viable solution in this context, aiming for enhancing the production system agility whilst not increasing the production set-up time and costs. In this regard, this paper proposes a local perception pipeline to estimate joint welding points using small-sized/low-cost 3D cameras, following an eyes-on-hand approach. A metrological 3D camera comparison between Intel Realsene D435, D415, and ZED Mini is also discussed, proving that the proposed pipeline associated with standard commercial 3D cameras is viable for welding operations in an industrial environment.

2022

Industrial robot programming by demonstration using stereoscopic vision and inertial sensing

Autores
de Souza, JPC; Amorim, AM; Rocha, LF; Pinto, VH; Moreira, AP;

Publicação
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION

Abstract
Purpose The purpose of this paper is to present a programming by demonstration (PbD) system based on 3D stereoscopic vision and inertial sensing that provides a cost-effective pose tracking system, even during error-prone situations, such as camera occlusions. Design/methodology/approach The proposed PbD system is based on the 6D Mimic innovative solution, whose six degrees of freedom marker hardware had to be revised and restructured to accommodate an IMU sensor. Additionally, a new software pipeline was designed to include this new sensing device, seeking the improvement of the overall system's robustness in stereoscopic vision occlusion situations. Findings The IMU component and the new software pipeline allow the 6D Mimic system to successfully maintain the pose tracking when the main tracking tool, i.e. the stereoscopic vision, fails. Therefore, the system improves in terms of reliability, robustness, and accuracy which were verified by real experiments. Practical implications Based on this proposal, the 6D Mimic system reaches a reliable and low-cost PbD methodology. Therefore, the robot can accurately replicate, on an industrial scale, the artisan level performance of highly skilled shop-floor operators. Originality/value To the best of the authors' knowledge, the sensor fusion between stereoscopic images and IMU applied to robot PbD is a novel approach. The system is entirely designed aiming to reduce costs and taking advantage of an offline processing step for data analysis, filtering and fusion, enhancing the reliability of the PbD system.

2023

Bin Picking for Ship-Building Logistics Using Perception and Grasping Systems

Autores
Cordeiro, A; Souza, JP; Costa, CM; Filipe, V; Rocha, LF; Silva, MF;

Publicação
ROBOTICS

Abstract
Bin picking is a challenging task involving many research domains within the perception and grasping fields, for which there are no perfect and reliable solutions available that are applicable to a wide range of unstructured and cluttered environments present in industrial factories and logistics centers. This paper contributes with research on the topic of object segmentation in cluttered scenarios, independent of previous object shape knowledge, for textured and textureless objects. In addition, it addresses the demand for extended datasets in deep learning tasks with realistic data. We propose a solution using a Mask R-CNN for 2D object segmentation, trained with real data acquired from a RGB-D sensor and synthetic data generated in Blender, combined with 3D point-cloud segmentation to extract a segmented point cloud belonging to a single object from the bin. Next, it is employed a re-configurable pipeline for 6-DoF object pose estimation, followed by a grasp planner to select a feasible grasp pose. The experimental results show that the object segmentation approach is efficient and accurate in cluttered scenarios with several occlusions. The neural network model was trained with both real and simulated data, enhancing the success rate from the previous classical segmentation, displaying an overall grasping success rate of 87.5%.

2016

An optical fiber sensor and its application in UAVs for current measurements

Autores
Delgado, FS; Carvalho, JP; Coelho, TVN; Dos Santos, AB;

Publicação
Sensors (Switzerland)

Abstract
In this paper, we propose and experimentally investigate an optical sensor based on a novel combination of a long-period fiber grating (LPFG) with a permanent magnet to measure electrical current in unmanned aerial vehicles (UAVs). The proposed device uses a neodymium magnet attached to the grating structure, which suffers from an electromagnetic force produced when the current flows in the wire of the UAV engine. Therefore, it causes deformation on the sensor and thus, different shifts occur in the resonant bands of the transmission spectrum of the LPFG. Finally, the results show that it is possible to monitor electrical current throughout the entire operating range of the UAV engine from 0 A to 10 A in an effective and practical way with good linearity, reliability and response time, which are desirable characteristics in electrical current sensing. © 2016 by the authors; licensee MDPI, Basel, Switzerland.

2017

Autonomous Quadrotor for accurate positioning

Autores
Moraes, L; Carmo, LC; Campos, RF; Jucá, MA; Moreira, LS; Carvalho, JP; Texeira, AM; Silveira, DD; Coelho, TVN; Luis, A; Marcato, M; Dos Santos, AB;

Publicação
IEEE Aerospace and Electronic Systems Magazine

Abstract
Surveillance missions in vast, difficult access environments are responsible for logistic difficulties in comparison to using an in loco monitoring team. For this and many other reasons, solutions with robotic platforms such as unmanned aerial vehicles (UAVs), present economic advantages. © 1986-2012 IEEE.

2017

Autonomous UAV outdoor flight controlled by an embedded system using odroid and ROS

Autores
Carvalho, JP; Jucá, MA; Menezes, A; Olivi, LR; Marcato, ALM; dos Santos, AB;

Publicação
Lecture Notes in Electrical Engineering

Abstract
Unmanned Aerial Vehicles (UAVs) have become a prominent research field due to their vast applicability and reduced size. An appealing aspect of theUAVs is the ability to accomplish autonomous flights in several contexts and purposes, and a variety of applications have been developed, from military to civilian fields. The system proposed in this work is a novel and simplified interaction between the user and the UAV for autonomous flight, where the necessary computation is performed in an embedded computer, decreasing response time and eliminating the necessity of long-distance communication links with base stations. Results are presented with both hardware in the loop simulations and a real UAV using Pixhawk, and Odroid and ROS as companion computer and software platform for code development. © Springer International Publishing Switzerland 2017.

  • 3
  • 3