Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Tópicos
de interesse
Detalhes

Detalhes

  • Nome

    André Rodrigues Baltazar
  • Cargo

    Investigador Auxiliar
  • Desde

    04 julho 2018
012
Publicações

2025

Spray Quality Assessment on Water-Sensitive Paper Comparing AI and Classical Computer Vision Methods

Autores
Simoes, I; Sousa, AJ; Baltazar, A; Santos, F;

Publicação
AGRICULTURE-BASEL

Abstract
Precision agriculture seeks to optimize crop yields while minimizing resource use. A key challenge is achieving uniform pesticide spraying to prevent crop damage and environmental contamination. Water-sensitive paper (WSP) is a common tool used for assessing spray quality, as it visually registers droplet impacts through color change. This work introduces a smartphone-based solution for capturing WSP images within vegetation, offering a tool for farmers to assess spray quality in real-world conditions. To achieve this, two approaches were explored: classical computer vision techniques and machine learning (ML) models (YOLOv8, Mask-RCNN, and Cellpose). Addressing the challenges of limited real-world data and the complexity of manual annotation, a programmatically generated synthetic dataset was employed to enable sim-to-real transfer learning. For the task of WSP segmentation within vegetation, YOLOv8 achieved an average Intersection over Union of 97.76%. In the droplet detection task, which involves identifying individual droplets on WSP, Cellpose achieved the highest precision of 96.18%, in the presence of overlapping droplets. While classical computer vision techniques provided a reliable baseline, they struggled with complex cases. Additionally, ML models, particularly Cellpose, demonstrated accurate droplet detection even without fine-tuning.

2024

Vision-Based Smart Sprayer for Precision Farming

Autores
Deguchi, T; Baltazar, AR; dos Santos, FN; Mendonça, H;

Publicação
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE, VOL 2

Abstract
Since the advent of agriculture, humans have considered phytopharmaceutical products to control pests and reduce losses in farming. Sometimes some of these products, such pesticides, can potentially harm the soil life. In the literature there is evidence that AI and image processing can have a positive contribution to reduce phytopharmaceutical losses, when used in variable rate sprayers. However, it is possible to improve the existing sprayer system's precision, accuracy, and mechanical aspects. This work proposes spraying solution called GraDeS solution (Grape Detection Sprayer). GraDeS solution is a sprayer with two degrees of freedom, controlled by a AI-based algorithm to precisely treat grape bunches diseases. The experiments with the designed sprayer showed two key points. First, the deep learning algorithm recognized and tracked grape bunches. Even with structure movement and bunch covering, the algorithm employs several strategies to keep track of the discovered objects. Second, the robotic sprayer can improve precision in specified areas, such as exclusively spraying grape bunches. Because of the structure's reduced size, the system can be used in medium and small robots.

2024

Spray Quality Assessment on Water-Sensitive Paper Comparing AI and Classical Computer Vision Methods

Autores
Simões, I; Baltazar, AR; Sousa, A; dos Santos, FN;

Publicação
Proceedings of the 21st International Conference on Informatics in Control, Automation and Robotics, ICINCO 2024, Porto, Portugal, November 18-20, 2024, Volume 2.

Abstract
Over recent decades, precision agriculture has revolutionized farming by optimizing crop yields and reducing resource use through targeted applications. Existing portable spray quality assessors lack precision, especially in detecting overlapping droplets on water-sensitive paper. This proposal aims to develop a smartphone application that uses the integrated camera to assess spray quality. Two approaches were implemented for segmentation and evaluation of both the water-sensitive paper and the individual droplets: classical computer vision techniques and a pre-trained YOLOv8 deep learning model. Due to the labor-intensive nature of annotating real datasets, a synthetic dataset was created for model training through sim-to-real transfer. Results show YOLOv8 achieves commendable metrics and efficient processing times but struggles with low image resolution and small droplet sizes, scoring an average Intersection over Union of 97.76% for water-sensitive spray segmentation and 60.77% for droplet segmentation. Classical computer vision techniques demonstrate high precision but lower recall with a precision of 36.64% for water-sensitive paper and 90.85% for droplets. This study highlights the potential of advanced computer vision and deep learning in enhancing spray quality assessors, emphasizing the need for ongoing refinement to improve precision agriculture tools. © 2024 by SCITEPRESS-Science and Technology Publications, Lda.

2023

2D LiDAR-Based System for Canopy Sensing in Smart Spraying Applications

Autores
Baltazar, AR; Dos Santos, FN; De Sousa, ML; Moreira, AP; Cunha, JB;

Publicação
IEEE ACCESS

Abstract
The efficient application of phytochemical products in agriculture is a complex issue that demands optimised sprayers and variable rate technologies, which rely on advanced sensing systems to address challenges such as overdosage and product losses. This work developed a system capable of processing different tree canopy parameters to support precision fruit farming and environmental protection using intelligent spraying methodologies. This system is based on a 2D light detection and ranging (LiDAR) sensor and a Global Navigation Satellite System (GNSS) receiver integrated into a sprayer driven by a tractor. The algorithm detects the canopy boundaries, allowing spray only in the presence of vegetation. The spray volume spared evaluates the system's performance compared to a Tree Row Volume (TRV) methodology. The results showed a 28% reduction in the overdosage of spraying product. The second step in this work was calculating and adjusting the amount of liquid to apply based on the tree volume. Considering this parameter, the saving obtained had an average value for the right and left rows of 78%. The volume of the trees was also monitored in a georeferenced manner with the creation of a occupation grid map. This map recorded the trajectory of the sprayer and the detected trees according to their volume.

2023

Sound-Based Anomalies Detection in Agricultural Robotics Application

Autores
Baltazar, AR; dos Santos, FN; Soares, SP; Moreira, AP; Cunha, JB;

Publicação
PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2023, PT II

Abstract
Agricultural robots are exposed to adverse conditions reducing the components' lifetime. To reduce the number of inspection, repair and maintenance activities, we propose using audio-based systems to diagnose and detect anomalies in these robots. Audio-based systems are non-destructive/intrusive solutions. Besides, it provides a significant amount of data to diagnose problems and for a wiser scheduler for preventive activities. So, in this work, we installed two microphones in an agricultural robot with a mowing tool. Real audio data was collected with the robotic mowing tool operating in several conditions and stages. Besides, a Sound-based Anomalies Detector (SAD) is proposed and tested with this dataset. The SAD considers a short-time Fourier transform (STFT) computation stage connected to a Support Vector Machine (SVM) classifier. The results with the collected dataset showed an F1 score between 95% and 100% in detecting anomalies in a mowing robot operation.