Detalhes
Nome
Tamas KaracsonyCargo
Assistente de InvestigaçãoDesde
01 maio 2019
Nacionalidade
HungriaContactos
+351222094000
tamas.karacsony@inesctec.pt
2023
Autores
Carmona, J; Karacsony, T; Cunha, JPS;
Publicação
2023 IEEE 7TH PORTUGUESE MEETING ON BIOENGINEERING, ENBENG
Abstract
Clinical in-bed video-based human motion analysis is a very relevant computer vision topic for several relevant biomedical applications. Nevertheless, the main public large datasets (e.g. ImageNet or 3DPW) used for deep learning approaches lack annotated examples for these clinical scenarios. To address this issue, we introduce BlanketSet, an RGB-IRD action recognition dataset of sequences performed in a hospital bed. This dataset has the potential to help bridge the improvements attained in more general large datasets to these clinical scenarios. Information on how to access the dataset is available at rdm.inesctec.pt/dataset/nis-2022-004.
2023
Autores
Carmona, J; Karacsony, T; Cunha, JPS;
Publicação
2023 IEEE 7TH PORTUGUESE MEETING ON BIOENGINEERING, ENBENG
Abstract
Human motion analysis has seen drastic improvements recently, however, due to the lack of representative datasets, for clinical in-bed scenarios it is still lagging behind. To address this issue, we implemented BlanketGen, a pipeline that augments videos with synthetic blanket occlusions. With this pipeline, we generated an augmented version of the pose estimation dataset 3DPW called BlanketGen3DPW. We then used this new dataset to fine-tune a Deep Learning model to improve its performance in these scenarios with promising results. Code and further information are available at https://gitlab.inesctec.pt/brain-lab/brainlab-public/blanket-gen-releases.
2023
Autores
Karacsony, T; Jeni, LA; De La Torre Frade, F; Cunha, JPS;
Publicação
Abstract
2022
Autores
Karacsony, T; Loesch-Biffar, AM; Vollmar, C; Remi, J; Noachtar, S; Cunha, JPS;
Publicação
SCIENTIFIC REPORTS
Abstract
Seizure semiology is a well-established method to classify epileptic seizure types, but requires a significant amount of resources as long-term Video-EEG monitoring needs to be visually analyzed. Therefore, computer vision based diagnosis support tools are a promising approach. In this article, we utilize infrared (IR) and depth (3D) videos to show the feasibility of a 24/7 novel object and action recognition based deep learning (DL) monitoring system to differentiate between epileptic seizures in frontal lobe epilepsy (FLE), temporal lobe epilepsy (TLE) and non-epileptic events. Based on the largest 3Dvideo-EEG database in the world (115 seizures/+680,000 video-frames/427GB), we achieved a promising cross-subject validation f1-score of 0.833 +/- 0.061 for the 2 class (FLE vs. TLE) and 0.763 +/- 0.083 for the 3 class (FLE vs. TLE vs. non-epileptic) case, from 2 s samples, with an automated semi-specialized depth (Acc.95.65%) and Mask R-CNN (Acc.96.52%) based cropping pipeline to pre-process the videos, enabling a near-real-time seizure type detection and classification tool. Our results demonstrate the feasibility of our novel DL approach to support 24/7 epilepsy monitoring, outperforming all previously published methods.
2021
Autores
Karácsony, T; Loesch Biffar, AM; Vollmar, C; Noachtar, S; Cunha, JPS;
Publicação
BHI 2021 - 2021 IEEE EMBS International Conference on Biomedical and Health Informatics, Proceedings
Abstract
Epilepsy is a major neurological disorder affecting approximately 1% of the world population, where seizure semiology is an essential tool for clinical evaluation of seizures. This includes qualitative visual inspection of videos from the seizures in epilepsy monitoring units by epileptologists. In order to support this clinical diagnosis process, promising deep learning-based systems were proposed. However, these indicate that video datasets of epileptic seizures are still rare and limited in size. In order to enable the full potential of AI systems for epileptic seizure diagnosis support and research, a novel collaborative development framework is proposed for a scalable DL-assisted clinical research and diagnosis support of epileptic seizures. The designed cloud-based approach integrates our deployed and tested NeuroKinect data acquisition pipeline into an MLOps framework to scale data set extension and analysis to a multi-clinical utilization. The proposed development framework incorporates an MLOps approach, to ensure convenient collaboration between clinicians and data scientists, providing continuous advantages to both user groups. It addresses methods for efficient utilization of HW, SW and human resources. In the future, the system is going to be expanded with several AI-based tools. Such as DL-based automated 3D motion capture (MoCap), 3D movement analysis support, quantitative seizure semiology analysis tools, video-based MOI and seizure classification. © 2021 IEEE
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.