Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por CRIIS

2024

Assessment of Multiple Fiducial Marker Trackers on Hololens 2

Autores
Costa, GM; Petry, MR; Martins, JG; Moreira, APGM;

Publicação
IEEE ACCESS

Abstract
Fiducial markers play a fundamental role in various fields in which precise localization and tracking are paramount. In Augmented Reality, they provide a known reference point in the physical world so that AR systems can accurately identify, track, and overlay virtual objects. This accuracy is essential for creating a seamless and immersive AR experience, particularly when prompted to cope with the sub-millimeter requirements of medical and industrial applications. This research article presents a comparative analysis of four fiducial marker tracking algorithms, aiming to assess and benchmark their accuracy and precision. The proposed methodology compares the pose estimated by four algorithms running on Hololens 2 with those provided by a highly accurate ground truth system. Each fiducial marker was positioned in 25 sampling points with different distances and orientations. The proposed evaluation method is not influenced by human error, relying only on a high-frequency and accurate motion tracking system as ground truth. This research shows that it is possible to track the fiducial markers with translation and rotation errors as low as 1.36 mm and 0.015 degrees using ArUco and Vuforia, respectively.

2024

The CrossLog System Concept and Architecture

Autores
Silva, F; Rebelo, M; Sobreira, H; Ribeiro, F;

Publicação
Lecture Notes in Mechanical Engineering

Abstract
Logistics chains are being increasingly developed due to several factors, among which the exponential growth of e-commerce. Crossdocking is a logistics strategy used by several companies from varied economic sectors, applied in warehouses and distribution centres. In this context, it is the objective of the “CrossLog – Automatic Mixed-Palletizing for Crossdocking Logistics Centers” Project, to investigate and study an automated and collaborative crossdocking system, capable of moving and managing the flow of products within the warehouse in the fastest and safest way. In its scope, this paper describes the concept and architecture envisioned for the crossdocking system developed in the scope of the CrossLog Project. One of its main distinguishing characteristics is the use of Autonomous Mobile Robots for performing much of the operations traditionally performed by human operators in today’s logistics centres. © 2024, The Author(s), under exclusive license to Springer Nature Switzerland AG.

2024

Fusion of Time-of-Flight Based Sensors with Monocular Cameras for a Robotic Person Follower

Autores
Sarmento, J; dos Santos, FN; Aguiar, AS; Filipe, V; Valente, A;

Publicação
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS

Abstract
Human-robot collaboration (HRC) is becoming increasingly important in advanced production systems, such as those used in industries and agriculture. This type of collaboration can contribute to productivity increase by reducing physical strain on humans, which can lead to reduced injuries and improved morale. One crucial aspect of HRC is the ability of the robot to follow a specific human operator safely. To address this challenge, a novel methodology is proposed that employs monocular vision and ultra-wideband (UWB) transceivers to determine the relative position of a human target with respect to the robot. UWB transceivers are capable of tracking humans with UWB transceivers but exhibit a significant angular error. To reduce this error, monocular cameras with Deep Learning object detection are used to detect humans. The reduction in angular error is achieved through sensor fusion, combining the outputs of both sensors using a histogram-based filter. This filter projects and intersects the measurements from both sources onto a 2D grid. By combining UWB and monocular vision, a remarkable 66.67% reduction in angular error compared to UWB localization alone is achieved. This approach demonstrates an average processing time of 0.0183s and an average localization error of 0.14 meters when tracking a person walking at an average speed of 0.21 m/s. This novel algorithm holds promise for enabling efficient and safe human-robot collaboration, providing a valuable contribution to the field of robotics.

2024

Reagentless Vis-NIR Spectroscopy Point-of-Care for Feline Total White Blood Cell Counts

Autores
Barroso, TG; Queirós, C; Monteiro-Silva, F; Santos, F; Gregório, AH; Martins, RC;

Publicação
BIOSENSORS-BASEL

Abstract
Spectral point-of-care technology is reagentless with minimal sampling (<10 mu L) and can be performed in real-time. White blood cells are non-dominant in blood and in spectral information, suffering significant interferences from dominant constituents such as red blood cells, hemoglobin and billirubin. White blood cells of a bigger size can account for 0.5% to 22.5% of blood spectra information. Knowledge expansion was performed using data augmentation through the hybridization of 94 real-world blood samples into 300 synthetic data samples. Synthetic data samples are representative of real-world data, expanding the detailed spectral information through sample hybridization, allowing us to unscramble the spectral white blood cell information from spectra, with correlations of 0.7975 to 0.8397 and a mean absolute error of 32.25% to 34.13%; furthermore, we achieved a diagnostic efficiency between 83% and 100% inside the reference interval (5.5 to 19.5 x 10(9) cell/L), and 85.11% for cases with extreme high white blood cell counts. At the covariance mode level, white blood cells are quantified using orthogonal information on red blood cells, maximizing sensitivity and specificity towards white blood cells, and avoiding the use of non-specific natural correlations present in the dataset; thus, the specifity of white blood cells spectral information is increased. The presented research is a step towards high-specificity, reagentless, miniaturized spectral point-of-care hematology technology for Veterinary Medicine.

2024

Plant Disease Diagnosis Based on Hyperspectral Sensing: Comparative Analysis of Parametric Spectral Vegetation Indices and Nonparametric Gaussian Process Classification Approaches

Autores
Reis Pereira, M; Verrelst, J; Tosin, R; Rivera Caicedo, JP; Tavares, F; Neves dos Santos, F; Cunha, M;

Publicação
Agronomy

Abstract
Early and accurate disease diagnosis is pivotal for effective phytosanitary management strategies in agriculture. Hyperspectral sensing has emerged as a promising tool for early disease detection, yet challenges remain in effectively harnessing its potential. This study compares parametric spectral Vegetation Indices (VIs) and a nonparametric Gaussian Process Classification based on an Automated Spectral Band Analysis Tool (GPC-BAT) for diagnosing plant bacterial diseases using hyperspectral data. The study conducted experiments on tomato plants in controlled conditions and kiwi plants in field settings to assess the performance of VIs and GPC-BAT. In the tomato experiment, the modeling processes were applied to classify the spectral data measured on the healthy class of plants (sprayed with water only) and discriminate them from the data captured on plants inoculated with the two bacterial suspensions (108 CFU mL-1). In the kiwi experiment, the standard modeling results of the spectral data collected on nonsymptomatic plants were compared to the ones obtained using symptomatic plants’ spectral data. VIs, known for their simplicity in extracting biophysical information, successfully distinguished healthy and diseased tissues in both plant species. The overall accuracy achieved was 63% and 71% for tomato and kiwi, respectively. Limitations were observed, particularly in differentiating specific disease infections accurately. On the other hand, GPC-BAT, after feature reduction, showcased enhanced accuracy in identifying healthy and diseased tissues. The overall accuracy ranged from 70% to 75% in the tomato and kiwi case studies. Despite its effectiveness, the model faced challenges in accurately predicting certain disease infections, especially in the early stages. Comparative analysis revealed commonalities and differences in the spectral bands identified by both approaches, with overlaps in critical regions across plant species. Notably, these spectral regions corresponded to the absorption regions of various photosynthetic pigments and structural components affected by bacterial infections in plant leaves. The study underscores the potential of hyperspectral sensing in disease diagnosis and highlights the strengths and limitations of VIs and GPC-BAT. The identified spectral features hold biological significance, suggesting correlations between bacterial infections and alterations in plant pigments and structural components. Future research avenues could focus on refining these approaches for improved accuracy in diagnosing diverse plant–pathogen interactions, thereby aiding disease diagnosis. Specifically, efforts could be directed towards adapting these methodologies for early detection, even before symptom manifestation, to better manage agricultural diseases.

2024

Vision Robotics for the Automatic Assessment of the Diabetic Foot

Autores
Mesquita, R; Costa, T; Coelho, L; Silva, F;

Publicação
Lecture Notes in Mechanical Engineering

Abstract
Diabetes, a chronic condition affecting millions of people, requires ongoing medical care and treatment, which can place a significant financial burden on society, directly and indirectly. In this paper we propose a vision-robotics system for the automatic assessment of the diabetic foot, one the exams used for the disease management. We present and discuss various computer vision techniques that can support the core operation of the system. U-Net and Segnet, two popular convolutional network architectures for image segmentation are applied in the current case. Hardcoded and machine learning pipelines are explained and compared using different metrics and scenarios. The obtained results show the advantages of the machine learning approach but also point to the importance of hard coded rules, especially when well know areas, such as the human foot, are the systems’ target. Overall, the system achieved very good results, paving the way to a fully automated clinical system. © 2024, The Author(s), under exclusive license to Springer Nature Switzerland AG.

  • 2
  • 349