Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
About

About

Rafael Marques Claro. He completed his PhD in Electrical and Computer Engineering in 2024 at the University of Porto, Faculty of Engineering, and works in the fields of Engineering Sciences and Technologies with an emphasis on Robotics and Automation.

Interest
Topics
Details

Details

  • Name

    Rafael Claro
  • Role

    Assistant Researcher
  • Since

    17th February 2020
005
Publications

2025

A Multimodal Perception System for Precise Landing of UAVs in Offshore Environments

Authors
Claro, RM; Neves, FSP; Pinto, AMG;

Publication
Journal of Field Robotics

Abstract
The integration of precise landing capabilities into unmanned aerial vehicles (UAVs) is crucial for enabling autonomous operations, particularly in challenging environments such as the offshore scenarios. This work proposes a heterogeneous perception system that incorporates a multimodal fiducial marker, designed to improve the accuracy and robustness of autonomous landing of UAVs in both daytime and nighttime operations. This work presents ViTAL-TAPE, a visual transformer-based model, that enhance the detection reliability of the landing target and overcomes the changes in the illumination conditions and viewpoint positions, where traditional methods fail. VITAL-TAPE is an end-to-end model that combines multimodal perceptual information, including photometric and radiometric data, to detect landing targets defined by a fiducial marker with 6 degrees-of-freedom. Extensive experiments have proved the ability of VITAL-TAPE to detect fiducial markers with an error of 0.01 m. Moreover, experiments using the RAVEN UAV, designed to endure the challenging weather conditions of offshore scenarios, demonstrated that the autonomous landing technology proposed in this work achieved an accuracy up to 0.1 m. This research also presents the first successful autonomous operation of a UAV in a commercial offshore wind farm with floating foundations installed in the Atlantic Ocean. These experiments showcased the system's accuracy, resilience and robustness, resulting in a precise landing technology that extends mission capabilities of UAVs, enabling autonomous and Beyond Visual Line of Sight offshore operations. © 2025 Wiley Periodicals LLC.

2024

A Multimodal Learning-based Approach for Autonomous Landing of UAV

Authors
Neves, FS; Branco, LM; Pereira, M; Claro, RM; Pinto, AM;

Publication
2024 20TH IEEE/ASME INTERNATIONAL CONFERENCE ON MECHATRONIC AND EMBEDDED SYSTEMS AND APPLICATIONS, MESA 2024

Abstract
In the field of autonomous Unmanned Aerial Vehicles (UAVs) landing, conventional approaches fall short in delivering not only the required precision but also the resilience against environmental disturbances. Yet, learning-based algorithms can offer promising solutions by leveraging their ability to learn the intelligent behaviour from data. On one hand, this paper introduces a novel multimodal transformer-based Deep Learning detector, that can provide reliable positioning for precise autonomous landing. It surpasses standard approaches by addressing individual sensor limitations, achieving high reliability even in diverse weather and sensor failure conditions. It was rigorously validated across varying environments, achieving optimal true positive rates and average precisions of up to 90%. On the other hand, it is proposed a Reinforcement Learning (RL) decision-making model, based on a Deep Q-Network (DQN) rationale. Initially trained in simulation, its adaptive behaviour is successfully transferred and validated in a real outdoor scenario. Furthermore, this approach demonstrates rapid inference times of approximately 5ms, validating its applicability on edge devices.

2024

A Multimodal Perception System for Precise Landing of UAVs in Offshore Environments

Authors
Claro, RM; Neves, FSP; Pinto, AMG;

Publication

Abstract
The integration of precise landing capabilities into UAVs is crucial for enabling autonomous operations, particularly in challenging environments such as the offshore scenarios. This work proposes a heterogeneous perception system that incorporates a multimodal fiducial marker, designed to improve the accuracy and robustness of autonomous landing of UAVs in both daytime and nighttime operations. This work presents ViTAL-TAPE, a visual transformer-based model, that enhance the detection reliability of the landing target and overcomes the changes in the illumination conditions and viewpoint positions, where traditional methods fail. VITAL-TAPE is an end-to-end model that combines multimodal perceptual information, including photometric and radiometric data, to detect landing targets defined by a fiducial marker with 6 degrees-of-freedom. Extensive experiments have proved the ability of VITAL-TAPE to detect fiducial markers with an error of 0.01 m. Moreover, experiments using the RAVEN UAV, designed to endure the challenging weather conditions of offshore scenarios, demonstrated that the autonomous landing technology proposed in this work achieved an accuracy up to 0.1 m. This research also presents the first successful autonomous operation of a UAV in a commercial offshore wind farm with floating foundations installed in the Atlantic Ocean. These experiments showcased the system’s accuracy, resilience and robustness, resulting in a precise landing technology that extends mission capabilities of UAVs, enabling autonomous and Beyond Visual Line of Sight offshore operations.

2024

Promoting the use of robotics in the inspection and maintenance of offshore wind

Authors
Pinto, AM; Matos, A; Marques, V; Campos, DF; Pereira, MI; Claro, R; Mikola, E; Formiga, J; El Mobachi, M; Stoker, J; Prevosto, J; Govindaraj, S; Ribas, D; Ridao, P; Aceto, L;

Publication
Robotics and Automation Solutions for Inspection and Maintenance in Critical Infrastructures

Abstract
This chapter presents the use of Robotics in the Inspection and Maintenance of Offshore Wind as another highly challenging environment where autonomous robotics systems and digital transformations are proving high value. © 2024 Andry Maykol Pinto | Aníbal Matos | João V. Amorim Marques | Daniel Filipe Campos | Maria Inês Pereira | Rafael Claro | Eeva Mikola | João Formiga | Mohammed El Mobachi | Jaap-Jan Stoker | Jonathan Prevosto | Shashank Govindaraj | David Ribas | Pere Ridao | Luca Aceto.

2024

DADDI: Offshore Floating Structure Aerial Dataset

Authors
Claro, R; Neves, F; Pereira, P; Pinto, A;

Publication
Oceans Conference Record (IEEE)

Abstract
With the expansion of offshore infrastructure, the necessity for efficient Operation and Maintenance (O&M) procedures intensifies. This article introduces DADDI, a multimodal dataset obtained from a real offshore floating structure, aimed at facilitating comprehensive inspections and 3D model creation. Leveraging Unmanned Aerial Vehicles (UAVs) equipped with advanced sensors, DADDI provides synchronized data, including visual images, thermal images, point clouds, GNSS, IMU, and odometry data. The dataset, gathered during a campaign at the ATLANTIS Coastal Testbed, offers over 2500 samples of each data type, along with intrinsic and extrinsic sensor calibrations. DADDI serves as a vital resource for the development and evaluation of algorithms, models, and technologies tailored to the inspection, monitoring, and maintenance of complex maritime structures. © 2024 IEEE.