Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by Filipe Neves Santos

2024

Enhancing Grapevine Node Detection to Support Pruning Automation: Leveraging State-of-the-Art YOLO Detection Models for 2D Image Analysis

Authors
Oliveira, F; da Silva, DQ; Filipe, V; Pinho, TM; Cunha, M; Cunha, JB; dos Santos, FN;

Publication
SENSORS

Abstract
Automating pruning tasks entails overcoming several challenges, encompassing not only robotic manipulation but also environment perception and detection. To achieve efficient pruning, robotic systems must accurately identify the correct cutting points. A possible method to define these points is to choose the cutting location based on the number of nodes present on the targeted cane. For this purpose, in grapevine pruning, it is required to correctly identify the nodes present on the primary canes of the grapevines. In this paper, a novel method of node detection in grapevines is proposed with four distinct state-of-the-art versions of the YOLO detection model: YOLOv7, YOLOv8, YOLOv9 and YOLOv10. These models were trained on a public dataset with images containing artificial backgrounds and afterwards validated on different cultivars of grapevines from two distinct Portuguese viticulture regions with cluttered backgrounds. This allowed us to evaluate the robustness of the algorithms on the detection of nodes in diverse environments, compare the performance of the YOLO models used, as well as create a publicly available dataset of grapevines obtained in Portuguese vineyards for node detection. Overall, all used models were capable of achieving correct node detection in images of grapevines from the three distinct datasets. Considering the trade-off between accuracy and inference speed, the YOLOv7 model demonstrated to be the most robust in detecting nodes in 2D images of grapevines, achieving F1-Score values between 70% and 86.5% with inference times of around 89 ms for an input size of 1280 x 1280 px. Considering these results, this work contributes with an efficient approach for real-time node detection for further implementation on an autonomous robotic pruning system.

2024

Towards On-Site Dairy Cow Mastitis Diagnosis in Your Pocket

Authors
Costa, A; Pereira, A; Pinho, L; Gregório, H; Santos, F; Moura, P; Marcos, R; Martins, RC;

Publication
The 4th International Electronic Conference on Biosensors

Abstract

2024

YOLO-Based Tree Trunk Types Multispectral Perception: A Two-Genus Study at Stand-Level for Forestry Inventory Management Purposes

Authors
da Silva, DQ; Dos Santos, FN; Filipe, V; Sousa, AJ; Pires, EJS;

Publication
IEEE ACCESS

Abstract
Stand-level forest tree species perception and identification are needed for monitoring-related operations, being crucial for better biodiversity and inventory management in forested areas. This paper contributes to this knowledge domain by researching tree trunk types multispectral perception at stand-level. YOLOv5 and YOLOv8 - Convolutional Neural Networks specialized at object detection and segmentation - were trained to detect and segment two tree trunk genus (pine and eucalyptus) using datasets collected in a forest region in Portugal. The dataset comprises only two categories, which correspond to the two tree genus. The datasets were manually annotated for object detection and segmentation with RGB and RGB-NIR images, and are publicly available. The Small variant of YOLOv8 was the best model at detection and segmentation tasks, achieving an F1 measure above 87% and 62%, respectively. The findings of this study suggest that the use of extended spectra, including Visible and Near Infrared, produces superior results. The trained models can be integrated into forest tractors and robots to monitor forest genus across different spectra. This can assist forest managers in controlling their forest stands.

2024

Integrating Spectral Sensing and Systems Biology for Precision Viticulture: Effects of Shade Nets on Grapevine Leaves

Authors
Tosin, R; Portis, I; Rodrigues, L; Gonçalves, I; Barbosa, C; Teixeira, J; Mendes, RJ; Santos, F; Santos, C; Martins, R; Cunha, M;

Publication
HORTICULTURAE

Abstract
This study investigates how grapevines (Vitis vinifera L.) respond to shading induced by artificial nets, focusing on physiological and metabolic changes. Through a multidisciplinary approach, grapevines' adaptations to shading are presented via biochemical analyses and hyperspectral data that are then combined with systems biology techniques. In the study, conducted in a 'Moscatel Galego Branco' vineyard in Portugal's Douro Wine Region during post-veraison, shading was applied and predawn leaf water potential (Psi pd) was then measured to assess water stress. Biochemical analyses and hyperspectral data were integrated to explore adaptations to shading, revealing higher chlorophyll levels (chlorophyll a-b 117.39% higher) and increased Reactive Oxygen Species (ROS) levels in unshaded vines (52.10% higher). Using a self-learning artificial intelligence algorithm (SL-AI), simulations highlighted ROS's role in stress response and accurately predicted chlorophyll a (R2: 0.92, MAPE: 24.39%), chlorophyll b (R2: 0.96, MAPE: 17.61%), and ROS levels (R2: 0.76, MAPE: 52.17%). In silico simulations employing flux balance analysis (FBA) elucidated distinct metabolic phenotypes between shaded and unshaded vines across cellular compartments. Integrating these findings provides a systems biology approach for understanding grapevine responses to environmental stressors. The leveraging of advanced omics technologies and precise metabolic models holds immense potential for untangling grapevine metabolism and optimizing viticultural practices for enhanced productivity and quality.

2024

Spectral data augmentation for leaf nutrient uptake quantification

Authors
Martins, RC; Queirós, C; Silva, FM; Santos, F; Barroso, TG; Tosin, R; Cunha, M; Leao, M; Damásio, M; Martins, P; Silvestre, J;

Publication
BIOSYSTEMS ENGINEERING

Abstract
Data scarcity is a hurdle for physiology-based precision agriculture. Measuring nutrient uptake by visible-near infrared spectroscopy implies collecting spectral and compositional data from low-throughput, such as inductively coupled plasma optical emission spectroscopy. This paper introduces data augmentation in spectroscopy by hybridisation for expanding real-world data into synthetic datasets statistically representative of the real data, allowing the quantification of macronutrients (N, P, K, Ca, Mg, and S) and micronutrients (Fe, Mn, Zn, Cu, and B). Partial least squares (PLS), local partial least squares (LocPLS), and self-learning artificial intelligence (SLAI) were used to determine the capacity to expand the knowledge base. PLS using only real-world data (RWD) cannot quantify some nutrients (N and Cu in grapevine leaves and K, Ca, Mg, S, and Cu in apple tree leaves). The synthetic dataset of the study allowed predicting real-world leaf composition of macronutrients (N, P, K, Ca, Mg and S) (Pearson coefficient correlation (R) 0.61-0.94 and standard error (SE) 0.04-0.05%) and micronutrients (Fe, Mn, Zn, Cu and B) (R 0.66-0.91 and SE 0.88-3.98 ppm) in grapevine leaves using LocPLS and SLAI. The synthetic dataset loses significance if the real-world counterpart has low representativity, resulting in poor quantifications of macronutrients (R 0.51-0.72 and SE 0.02-0.13%) and micronutrients (R 0.53-0.76 and SE 8.89-37.89 ppm), and not allowing S quantification (R = 0.37, SE = 0.01) in apple tree leaves. Representative real-world sampling makes data augmentation in spectroscopy very efficient in expanding the knowledge base and nutrient quantifications.

2024

Vision-Based Smart Sprayer for Precision Farming

Authors
Deguchi, T; Baltazar, AR; dos Santos, FN; Mendonça, H;

Publication
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE, VOL 2

Abstract
Since the advent of agriculture, humans have considered phytopharmaceutical products to control pests and reduce losses in farming. Sometimes some of these products, such pesticides, can potentially harm the soil life. In the literature there is evidence that AI and image processing can have a positive contribution to reduce phytopharmaceutical losses, when used in variable rate sprayers. However, it is possible to improve the existing sprayer system's precision, accuracy, and mechanical aspects. This work proposes spraying solution called GraDeS solution (Grape Detection Sprayer). GraDeS solution is a sprayer with two degrees of freedom, controlled by a AI-based algorithm to precisely treat grape bunches diseases. The experiments with the designed sprayer showed two key points. First, the deep learning algorithm recognized and tracked grape bunches. Even with structure movement and bunch covering, the algorithm employs several strategies to keep track of the discovered objects. Second, the robotic sprayer can improve precision in specified areas, such as exclusively spraying grape bunches. Because of the structure's reduced size, the system can be used in medium and small robots.

  • 18
  • 24