Pedro Nuno

Abstract
Underwater environments pose unique challenges to optical systems due to physical phenomena that induce severe data degradation. Current imaging sensors rarely address these effects comprehensively, resulting in the need to integrate complementary information sources. This article presents a multimodal data fusion approach to combine information from diverse sensing modalities into a single dense and accurate tridimensional representation. The proposed fusiNg tExture with apparent motion information for underwater Scene recOnstruction (NESO) encoder-decoder network leverages motion perception principles to extract relative depth cues, fusing them with textured information through an early fusion strategy. Evaluated on the FLSea-Stereo dataset, NESO outperforms state-of-the-art methods by 58.7%. Dense depth maps are achieved using multi-stage skip connections with attention mechanisms that ensure propagation of key features across network levels. This representation is further enhanced by incorporating sparse but millimeter-precise depth measurements from active imaging techniques. A regression-based algorithm maps depth displacements between these heterogeneous point clouds, using the estimated curves to refine the dense NESO prediction. This approach achieves relative errors as low as 0.41% when reconstructing submerged anode structures, accounting for metric improvements of up to 0.1124 m relative to the initial measurements. Validation at the ATLANTIS Coastal Testbed demonstrates the effectiveness of this multimodal fusion approach in obtaining robust tri-dimensional representations in real underwater conditions.

Abstract
Exploiting stronger winds at offshore farms leads to a cyclical need for maintenance due to the harsh maritime conditions. While autonomous vehicles are the prone solution for O&M procedures, sub-sea phenomena induce severe data degradation that hinders the vessel's 3D perception. This article demonstrates a hybrid underwater imaging system that is capable of retrieving tri-dimensional information: dense and textured Photogrammetric Stereo (PS) point clouds and multiple accurate sets of points through Light Stripe Ranging (LSR), that are combined into a single dense and accurate representation. Two novel fusion algorithms are introduced in this manuscript. A Joint Masked Regression (JMR) methodology propagates sparse LSR information towards the PS point cloud, exploiting homogeneous regions around each beam projection. Regression curves then correlate depth readings from both inputs to correct the stereo-based information. On the other hand, the learning-based solution (RHEA) follows an early-fusion approach where features are conjointly learned from a coupled representation of both 3D inputs. A synthetic-to-real training scheme is employed to bypass domain-adaptation stages, enabling direct deployment in underwater contexts. Evaluation is conducted through extensive trials in simulation, controlled underwater environments, and within a real application at the ATLANTIS Coastal Testbed. Both methods estimate improved output point clouds, with RHEA achieving an average RMSE of 0.0097 m -a 52.45% improvement when compared to the PS input. Performance with real underwater information proves that RHEA is robust in dealing with degraded input information; JMR is more affected by missing information, excelling when the LSR data provides a complete representation of the scenario, and struggling otherwise.

Abstract
Underwater scenarios pose additional challenges to perception systems, as the collected imagery from sensors often suffers from limitations that hinder its practical usability. One crucial domain that relies on accurate underwater visibility assessment is underwater pipeline inspection. Manual assessment is impractical and time-consuming, emphasizing the need for automated algorithms. In this study, we focus on developing learning-based approaches to evaluate visibility in underwater environments. We explore various neural network architectures and evaluate them on data collected within real subsea scenarios. Notably, the ResNet18 model outperforms others, achieving a testing accuracy of 93.5% in visibility evaluation. In terms of inference time, the fastest model is MobileNetV3 Small, estimating a prediction within 42.45 ms. These findings represent significant progress in enabling unmanned marine operations and contribute to the advancement of autonomous underwater surveillance systems.

Abstract
Marine growth impacts the stability and integrity of offshore structures, while simultaneously preventing inspection procedures. In consequence, companies need to employ specialists that manually assess each impacted part of the structure. Due to harsh sub-sea environments, acquiring large quantities of quality underwater data becomes difficult. To mitigate these challenges a new data augmentation algorithm is proposed that generates new images by performing localized crops on regions of interest from the original data, expanding the total size of the dataset approximately 6 times. This research also proposes a learning-based algorithm capable of automatically delineating marine growth in underwater images, achieving up to 0.389 IoU and 0.508 Dice Loss. Advances in this area contribute for reducing the manual labour necessary to schedule maintenance operations in man-made submerged structures, while increasing the reliability and automation of the process.

Abstract
Offshore wind farms face harsh maritime conditions, prompting the use of sacrificial anodes to prevent rapid structural degradation. Regular maintenance and replacement of these elements are vital to ensure ongoing corrosion protection, maintain structural integrity, and optimize efficiency. This article details the design and validation of the MARESye hybrid underwater imaging system, capable of retrieving heterogeneous tri-dimensional information with millimetric precision for the close-range inspection of submerged critical structures. The optical prowess of the system is first validated during low turbidity trials where the volumetric properties of a decommissioned anode are reconstructed with absolute errors down to 0.0008 m, and its spatial dimensions are depicted with sub-millimeter precision accounting for relative errors as low as 0.31%. MARESye is later equipped as payload in a commercial ROV during areal environment inspection mission at the ATLANTIS Coastal Test Center. This experiment sees the sensor provide live reconstructions of a sacrificial anode, revealing a biofouling layer of approximately 0.0130 m thickness. The assessment of the high-fidelity 2D/3D information obtained from the MARESye sensor demonstrates its potential to enhance the situational awareness of underwater vehicles, fostering reliable O&M procedures.