Abstract
Directed Energy Deposition (DED) is crucial in additive manufacturing for various industries like aerospace, automotive, and biomedical. Precise temperature control is essential due to high-power lasers and dynamic environmental changes. Employing Reinforcement Learning (RL) can help with temperature control, but challenges arise from standardization and sample efficiency. In this study, a model-based Reinforcement Learning (MBRL) approach is used to train a DED model, improving control and efficiency. Computational models evaluate melt pool geometry and temporal characteristics during the process. The study employs the Allen-Cahn phase field (AC-PF) model using the Finite Element Method (FEM) with the Multi-physics Object-Oriented Simulation Environment (MOOSE). MBRL, specifically Dyna-Q+, outperforms traditional Q-learning, requiring fewer samples. Insights from this research aid in advancing RL techniques for laser metal additive manufacturing.

Abstract
Laser-based additive manufacturing (LAM) offers the ability to produce near-net-shape metal parts with unparalleled energy efficiency and flexibility in both geometry and material selection. Despite advantages, these processes are inherently, as they are characterized by multiphysics interactions, multiscale phenomena, and highly dynamic behaviors, making their modeling and optimization particularly challenging. Artificial intelligence (AI) has emerged as a promising tool for enhancing the monitoring and control of additive manufacturing. This paper presents a systematic review of AI applications for real-time control of laser-based manufacturing processes, analyzing 16 relevant articles sourced from Scopus, IEEE Xplore, and Web of Science databases. The primary objective of this work is to contribute to the advancement of autonomous manufacturing systems capable of self-monitoring and self-correction, ensuring optimal part quality, enhanced efficiency, and reduced human intervention. Our findings indicate that 62.5 % of the 16 analyzed studies have deployed AI-driven controllers in real-world scenarios, with over 56 % using AI for control strategies, such as Reinforcement Learning. Furthermore, 62.5 % of the studies employed AI for process modeling or monitoring, which was integral to the development or data pipelines of the controllers. By defining a groundwork for future developments, this review not only highlights current advancements but also hints future innovations that will likely include AI-based controllers.

Abstract
Precision agriculture seeks to optimize crop yields while minimizing resource use. A key challenge is achieving uniform pesticide spraying to prevent crop damage and environmental contamination. Water-sensitive paper (WSP) is a common tool used for assessing spray quality, as it visually registers droplet impacts through color change. This work introduces a smartphone-based solution for capturing WSP images within vegetation, offering a tool for farmers to assess spray quality in real-world conditions. To achieve this, two approaches were explored: classical computer vision techniques and machine learning (ML) models (YOLOv8, Mask-RCNN, and Cellpose). Addressing the challenges of limited real-world data and the complexity of manual annotation, a programmatically generated synthetic dataset was employed to enable sim-to-real transfer learning. For the task of WSP segmentation within vegetation, YOLOv8 achieved an average Intersection over Union of 97.76%. In the droplet detection task, which involves identifying individual droplets on WSP, Cellpose achieved the highest precision of 96.18%, in the presence of overlapping droplets. While classical computer vision techniques provided a reliable baseline, they struggled with complex cases. Additionally, ML models, particularly Cellpose, demonstrated accurate droplet detection even without fine-tuning.

Abstract
Artificial I ntelligence ( AI) a nd M achine Learning are frequently used to develop player skills in robotic soccer scenarios. Despite the potential of deep reinforcement learning, its computational demands pose challenges when learning complex behaviors. This work explores less demanding methods, namely Evolution Strategies (ES) and Hierarchical Reinforcement Learning (HRL), for enhancing coordination and cooperation between two agents from the FC Portugal 3D Simulation Soccer Team, in RoboCup. The goal is for two robots to learn a high-level skill that enables a robot to pass the ball to its teammate as quickly as possible. Results show that the trained models under-performed in a traditional robotic soccer two-agent task and scored perfectly in a much simpler one. Therefore, this work highlights that while these alternative methods can learn trivial cooperative behavior, more complex tasks are difficult t o learn.

Abstract
Effective navigation in mobile robotics relies on precise environmental mapping, including the detection of complex objects as geometric primitives. This work introduces a deep learning model that determines the pose, type, and dimensions of 2D primitives using a mobile robot equipped with a noisy LiDAR sensor. Simulated experiments conducted in Webots involved randomly placed primitives, with the robot capturing point clouds which were used to progressively build a map of the environment. Two mapping techniques were considered, a deterministic and probabilistic (Bayesian) mapping, and different levels of noise for the LiDAR were compared. The maps were used as input to a YOLOv5 network that detected the position and type of the primitives. A cropped image of each primitive was then fed to a Convolutional Neural Network (CNN) that determined the dimensions and orientation of a given primitive. Results show that the primitive classification achieved an accuracy of 95% in low noise, dropping to 85% under higher noise conditions, while the prediction of the shapes' dimensions had error rates from 5% to 12%, as the noise increased. The probabilistic mapping approach improved accuracy by 10-15% compared to deterministic methods, showcasing robustness to noise levels up to 0.1. Therefore, these findings highlight the effectiveness of probabilistic mapping in enhancing detection accuracy for mobile robot perception in noisy environments.

Abstract
Over recent decades, precision agriculture has revolutionized farming by optimizing crop yields and reducing resource use through targeted applications. Existing portable spray quality assessors lack precision, especially in detecting overlapping droplets on water-sensitive paper. This proposal aims to develop a smartphone application that uses the integrated camera to assess spray quality. Two approaches were implemented for segmentation and evaluation of both the water-sensitive paper and the individual droplets: classical computer vision techniques and a pre-trained YOLOv8 deep learning model. Due to the labor-intensive nature of annotating real datasets, a synthetic dataset was created for model training through sim-to-real transfer. Results show YOLOv8 achieves commendable metrics and efficient processing times but struggles with low image resolution and small droplet sizes, scoring an average Intersection over Union of 97.76% for water-sensitive spray segmentation and 60.77% for droplet segmentation. Classical computer vision techniques demonstrate high precision but lower recall with a precision of 36.64% for water-sensitive paper and 90.85% for droplets. This study highlights the potential of advanced computer vision and deep learning in enhancing spray quality assessors, emphasizing the need for ongoing refinement to improve precision agriculture tools. © 2024 by SCITEPRESS-Science and Technology Publications, Lda.