Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Interest
Topics
Details

Details

  • Name

    João Braun
  • Role

    Research Assistant
  • Since

    07th September 2022
Publications

2023

A Machine Learning Approach to Robot Localization Using Fiducial Markers in RobotAtFactory 4.0 Competition

Authors
Klein, LC; Braun, J; Mendes, J; Pinto, VH; Martins, FN; de Oliveira, AS; Wortche, H; Costa, P; Lima, J;

Publication
SENSORS

Abstract
Localization is a crucial skill in mobile robotics because the robot needs to make reasonable navigation decisions to complete its mission. Many approaches exist to implement localization, but artificial intelligence can be an interesting alternative to traditional localization techniques based on model calculations. This work proposes a machine learning approach to solve the localization problem in the RobotAtFactory 4.0 competition. The idea is to obtain the relative pose of an onboard camera with respect to fiducial markers (ArUcos) and then estimate the robot pose with machine learning. The approaches were validated in a simulation. Several algorithms were tested, and the best results were obtained by using Random Forest Regressor, with an error on the millimeter scale. The proposed solution presents results as high as the analytical approach for solving the localization problem in the RobotAtFactory 4.0 scenario, with the advantage of not requiring explicit knowledge of the exact positions of the fiducial markers, as in the analytical approach.

2022

RobotAtFactory 4.0: a ROS framework for the SimTwo simulator

Authors
Braun, J; Oliveira, A; Berger, GS; Lima, J; Pereira, AI; Costa, P;

Publication
2022 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC)

Abstract
Robotics competitions encourage the development of solutions to new challenges that emerge in sync with the rise of Industry 4.0. In this context, robotic simulators are employed to facilitate the development of these solutions by disseminating knowledge in robotics, Education 4.0, and STEM. The RobotAtFactory 4.0 competition arises to promote improvements in industrial challenges related to autonomous robots. The official organization provides the simulation scene of the competition through the open-source SimTwo simulator. This paper aims to integrate the SiwTwo simulator with the Robot Operating System (ROS) middleware by developing a framework. This integration facilitates the design of robotic systems since ROS has a vast repository of packages that address common problems in robotics. Thus, competitors can use this framework to develop their solutions through ROS, allowing the simulated and real systems to be integrated.

2022

Object Detection for Indoor Localization System

Authors
Braun, J; Mendes, J; Pereira, AI; Lima, J; Costa, P;

Publication
OPTIMIZATION, LEARNING ALGORITHMS AND APPLICATIONS, OL2A 2022

Abstract
The urge for robust and reliable localization systems for autonomous mobile robots (AMR) is increasing since the demand for these automated systems is rising in service, industry, and other areas of the economy. The localization of AMRs is one of the crucial challenges, and several approaches exist to solve this. The most well-known localization systems are based on LiDAR data due to their reliability, accuracy, and robustness. One standard method is to match the reference map information with the actual readings from LiDAR or camera sensors, allowing localization to be performed. However, this approach has difficulties handling anything that does not belong to the original map since it affects the matching algorithm's performance. Therefore, they should be considered outliers. In this paper, a deep learning-based object detection algorithm is not only used for detection but also to classify them as outliers from the localization's perspective. This is an innovative approach to improve the localization results in a realmobile platform. Results are encouraging, and the proposed methodology is being tested in a real robot.

2022

A robot localization proposal for the RobotAtFactory 4.0: A novel robotics competition within the Industry 4.0 concept

Authors
Braun, J; Junior, AO; Berger, G; Pinto, VH; Soares, IN; Pereira, AI; Lima, J; Costa, P;

Publication
FRONTIERS IN ROBOTICS AND AI

Abstract
Robotic competitions are an excellent way to promote innovative solutions for the current industries' challenges and entrepreneurial spirit, acquire technical and transversal skills through active teaching, and promote this area to the public. In other words, since robotics is a multidisciplinary field, its competitions address several knowledge topics, especially in the STEM (Science, Technology, Engineering, and Mathematics) category, that are shared among the students and researchers, driving further technology and science. A new competition encompassed in the Portuguese Robotics Open was created according to the Industry 4.0 concept in the production chain. In this competition, RobotAtFactory 4.0, a shop floor, is used to mimic a fully automated industrial logistics warehouse and the challenges it brings. Autonomous Mobile Robots (AMRs) must be used to operate without supervision and perform the tasks that the warehouse requests. There are different types of boxes which dictate their partial and definitive destinations. In this reasoning, AMRs should identify each and transport them to their destinations. This paper describes an approach to the indoor localization system for the competition based on the Extended Kalman Filter (EKF) and ArUco markers. Different innovation methods for the obtained observations were tested and compared in the EKF. A real robot was designed and assembled to act as a test bed for the localization system's validation. Thus, the approach was validated in the real scenario using a factory floor with the official specifications provided by the competition organization.

2022

Smart Systems for Monitoring Buildings - An IoT Application

Authors
Kalbermatter, RB; Brito, T; Braun, J; Pereira, AI; Ferreira, AP; Valente, A; Lima, J;

Publication
Optimization, Learning Algorithms and Applications - Second International Conference, OL2A 2022, Póvoa de Varzim, Portugal, October 24-25, 2022, Proceedings

Abstract