Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by CRIIS

2023

Deep Learning YOLO-Based Solution for Grape Bunch Detection and Assessment of Biophysical Lesions

Authors
Pinheiro, I; Moreira, G; da Silva, DQ; Magalhaes, S; Valente, A; Oliveira, PM; Cunha, M; Santos, F;

Publication
AGRONOMY-BASEL

Abstract
The world wine sector is a multi-billion dollar industry with a wide range of economic activities. Therefore, it becomes crucial to monitor the grapevine because it allows a more accurate estimation of the yield and ensures a high-quality end product. The most common way of monitoring the grapevine is through the leaves (preventive way) since the leaves first manifest biophysical lesions. However, this does not exclude the possibility of biophysical lesions manifesting in the grape berries. Thus, this work presents three pre-trained YOLO models (YOLOv5x6, YOLOv7-E6E, and YOLOR-CSP-X) to detect and classify grape bunches as healthy or damaged by the number of berries with biophysical lesions. Two datasets were created and made publicly available with original images and manual annotations to identify the complexity between detection (bunches) and classification (healthy or damaged) tasks. The datasets use the same 10,010 images with different classes. The Grapevine Bunch Detection Dataset uses the Bunch class, and The Grapevine Bunch Condition Detection Dataset uses the OptimalBunch and DamagedBunch classes. Regarding the three models trained for grape bunches detection, they obtained promising results, highlighting YOLOv7 with 77% of mAP and 94% of the F1-score. In the case of the task of detection and identification of the state of grape bunches, the three models obtained similar results, with YOLOv5 achieving the best ones with an mAP of 72% and an F1-score of 92%.

2023

Design and Control Architecture of a Triple 3 DoF SCARA Manipulator for Tomato Harvesting

Authors
Tinoco, V; Silva, MF; Santos, FN; Magalhaes, S; Morais, R;

Publication
2023 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
The increasing world population, growing need for agricultural products, and labour shortages have driven the growth of robotics in agriculture. Tasks such as fruit harvesting require extensive hours of work during harvest periods and can be physically exhausting. Autonomous robots bring more efficiency to agricultural tasks with the possibility of working continuously. This paper proposes a stackable 3 DoF SCARA manipulator for tomato harvesting. The manipulator uses a custom electronic circuit to control DC motors with an endless gear at each joint and uses a camera and a Tensor Processing Unit (TPU) for fruit detection. Cascaded PID controllers are used to control the joints with magnetic encoders for rotational feedback, and a time-of-flight sensor for prismatic movement feedback. Tomatoes are detected using an algorithm that finds regions of interest with the red colour present and sends these regions of interest to an image classifier that evaluates whether or not a tomato is present. With this, the system calculates the position of the tomato using stereo vision obtained from a monocular camera combined with the prismatic movement of the manipulator. As a result, the manipulator was able to position itself very close to the target in less than 3 seconds, where an end-effector could adjust its position for the picking.

2023

Reagent-less spectroscopy towards NPK sensing for hydroponics nutrient solutions

Authors
Silva, FM; Queirós, C; Pinho, T; Boaventura, J; Santos, F; Barroso, TG; Pereira, MR; Cunha, M; Martins, RC;

Publication
SENSORS AND ACTUATORS B-CHEMICAL

Abstract
Nutrient quantification in hydroponic systems is essential. Reagent-less spectral quantification of nitrogen, phosphate and potassium faces challenges in accessing information-rich spectral signals and unscrambling interference from each constituent. Herein, we introduce information equivalence between spectra and sample composition, enabling extraction of consistent covariance to isolate nutrient-specific spectral information (N, P or K) in Hoagland nutrient solutions using orthogonal covariance modes. Chemometrics methods quantify nitrogen and potassium, but not phosphate. Orthogonal covariance modes, however, enable quantification of all three nutrients: nitrogen (N) with R = 0.9926 and standard error of 17.22 ppm, phosphate (P) with R = 0.9196 and standard error of 63.62 ppm, and potassium (K) with R = 0.9975 and standard error of 9.51 ppm. Including pH information significantly improves phosphate quantification (R = 0.9638, standard error: 43.16 ppm). Results demonstrate a direct relationship between spectra and Hoagland nutrient solution information, preserving NPK orthogonality and supporting orthogonal covariance modes. These modes enhance detection sensitivity by maximizing information of the constituent being quantified, while minimizing interferences from others. Orthogonal covariance modes predicted nitrogen (R = 0.9474, standard error: 29.95 ppm) accurately. Phosphate and potassium showed strong interference from contaminants, but most extrapolation samples were correctly diagnosed above the reference interval (83.26%). Despite potassium features outside the knowledge base, a significant correlation was obtained (R = 0.6751). Orthogonal covariance modes use unique N, P or K information for quantification, not spurious correlations due to fertilizer composition. This approach minimizes interferences during extrapolation to complex samples, a crucial step towards resilient nutrient management in hydroponics using spectroscopy.

2023

Enhancing host-pathogen phenotyping dynamics: early detection of tomato bacterial diseases using hyperspectral point measurement and predictive modeling

Authors
Pereira, MR; dos Santos, FN; Tavares, F; Cunha, M;

Publication
FRONTIERS IN PLANT SCIENCE

Abstract
Early diagnosis of plant diseases is needed to promote sustainable plant protection strategies. Applied predictive modeling over hyperspectral spectroscopy (HS) data can be an effective, fast, cost-effective approach for improving plant disease diagnosis. This study aimed to investigate the potential of HS point-of-measurement (POM) data for in-situ, non-destructive diagnosis of tomato bacterial speck caused by Pseudomonas syringae pv. tomato (Pst), and bacterial spot, caused by Xanthomonas euvesicatoria (Xeu), on leaves (cv. cherry). Bacterial artificial infection was performed on tomato plants at the same phenological stage. A sensing system composed by a hyperspectral spectrometer, a transmission optical fiber bundle with a slitted probe and a white light source were used for spectral data acquisition, allowing the assessment of 3478 spectral points. An applied predictive classification model was developed, consisting of a normalizing pre-processing strategy allied with a Linear Discriminant Analysis (LDA) for reducing data dimensionality and a supervised machine learning algorithm (Support Vector Machine - SVM) for the classification task. The predicted model achieved classification accuracies of 100% and 74% for Pst and Xeu test set assessments, respectively, before symptom appearance. Model predictions were coherent with host-pathogen interactions mentioned in the literature (e.g., changes in photosynthetic pigment levels, production of bacterial-specific molecules, and activation of plants' defense mechanisms). Furthermore, these results were coherent with visual phenotyping inspection and PCR results. The reported outcomes support the application of spectral point measurements acquired in-vivo for plant disease diagnosis, aiming for more precise and eco-friendly phytosanitary approaches.

2023

Automated Infield Grapevine Inflorescence Segmentation Based on Deep Learning Models

Authors
Moreira, G; Magalhães, SA; dos Santos, FN; Cunha, M;

Publication
IECAG 2023

Abstract

2023

Enhancing Grape Brix Prediction in Precision Viticulture: A Benchmarking Study of Predictive Models using Hyperspectral Proximal Sensors

Authors
Santos-Campos, M; Tosin, R; Rodrigues, L; Gonçalves, I; Barbosa, C; Martins, R; Santos, F; Cunha, M;

Publication
The 3rd International Electronic Conference on Agronomy

Abstract

  • 52
  • 363