Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Detalhes

Detalhes

  • Nome

    João Paulo Cunha
  • Cargo

    Coordenador de Centro
  • Desde

    01 janeiro 2013
024
Publicações

2024

Assessing the perceptual equivalence of a firefighting training exercise across virtual and real environments

Autores
Narciso, D; Melo, M; Rodrigues, S; Dias, D; Cunha, J; Vasconcelos-Raposo, J; Bessa, M;

Publicação
VIRTUAL REALITY

Abstract
The advantages of Virtual Reality (VR) over traditional training, together with the development of VR technology, have contributed to an increase in the body of literature on training professionals with VR. However, there is a gap in the literature concerning the comparison of training in a Virtual Environment (VE) with the same training in a Real Environment (RE), which would contribute to a better understanding of the capabilities of VR in training. This paper presents a study with firefighters (N = 12) where the effect of a firefighter training exercise in a VE was evaluated and compared to that of the same exercise in a RE. The effect of environments was evaluated using psychophysiological measures by evaluating the perception of stress and fatigue, transfer of knowledge, sense of presence, cybersickness, and the actual stress measured through participants' Heart Rate Variability (HRV). The results showed a similar perception of stress and fatigue between the two environments; a positive, although not significant, effect of the VE on the transfer of knowledge; the display of moderately high presence values in the VE; the ability of the VE not to cause symptoms of cybersickness; and finally, obtaining signs of stress in participants' HRV in the RE and, to a lesser extent, signs of stress in the VE. Although the effect of the VE was shown to be non-comparable to that of the RE, the authors consider the results encouraging and discuss some key factors that should be addressed in the future to improve the results of the training VE.

2023

Studying the Influence of Multisensory Stimuli on a Firefighting Training Virtual Environment

Autores
Narciso, D; Melo, M; Rodrigues, S; Cunha, JP; Vasconcelos-Raposo, J; Bessa, M;

Publicação
IEEE Transactions on Visualization and Computer Graphics

Abstract

2023

Using Heart Rate Variability for Comparing the Effectiveness of Virtual vs Real Training Environments for Firefighters

Autores
Narciso, D; Melo, M; Rodrigues, S; Cunha, JP; Vasconcelos-Raposo, J; Bessa, M;

Publicação
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS

Abstract
The use of Virtual Reality (VR) technology to train professionals has increased over the years due to its advantages over traditional training. This paper presents a study comparing the effectiveness of a Virtual Environment (VE) and a Real Environment (RE) designed to train firefighters. To measure the effectiveness of the environments, a new method based on participants' Heart Rate Variability (HRV) was used. This method was complemented with self-reports, in the form of questionnaires, of fatigue, stress, sense of presence, and cybersickness. An additional questionnaire was used to measure and compare knowledge transfer enabled by the environments. The results from HRV analysis indicated that participants were under physiological stress in both environments, albeit with less intensity on the VE. Regarding reported fatigue and stress, the results showed that none of the environments increased such variables. The results of knowledge transfer showed that the VE obtained a significant increase while the RE obtained a positive but non-significant increase (median values, VE: before - 4 after - 7, p = .003; RE: before - 4 after - 5, p = .375). Lastly, the results of presence and cybersickness suggested that participants experienced high overall presence and no cybersickness. Considering all results, the authors conclude that the VE provided effective training but that its effectiveness was lower than that of the RE.

2023

BlanketSet - A Clinical Real-World In-Bed Action Recognition and Qualitative Semi-Synchronised Motion Capture Dataset

Autores
Carmona, J; Karacsony, T; Cunha, JPS;

Publicação
2023 IEEE 7TH PORTUGUESE MEETING ON BIOENGINEERING, ENBENG

Abstract
Clinical in-bed video-based human motion analysis is a very relevant computer vision topic for several relevant biomedical applications. Nevertheless, the main public large datasets (e.g. ImageNet or 3DPW) used for deep learning approaches lack annotated examples for these clinical scenarios. To address this issue, we introduce BlanketSet, an RGB-IRD action recognition dataset of sequences performed in a hospital bed. This dataset has the potential to help bridge the improvements attained in more general large datasets to these clinical scenarios. Information on how to access the dataset is available at rdm.inesctec.pt/dataset/nis-2022-004.

2023

BlanketGen - A Synthetic Blanket Occlusion Augmentation Pipeline for Motion Capture Datasets

Autores
Carmona, J; Karacsony, T; Cunha, JPS;

Publicação
2023 IEEE 7TH PORTUGUESE MEETING ON BIOENGINEERING, ENBENG

Abstract
Human motion analysis has seen drastic improvements recently, however, due to the lack of representative datasets, for clinical in-bed scenarios it is still lagging behind. To address this issue, we implemented BlanketGen, a pipeline that augments videos with synthetic blanket occlusions. With this pipeline, we generated an augmented version of the pose estimation dataset 3DPW called BlanketGen3DPW. We then used this new dataset to fine-tune a Deep Learning model to improve its performance in these scenarios with promising results. Code and further information are available at https://gitlab.inesctec.pt/brain-lab/brainlab-public/blanket-gen-releases.

Teses
supervisionadas

2022

New Methods and Applications for Invisible Electrocardiography (ECG)

Autor
Aline dos Santos Silva

Instituição
UP-FEUP

2022

Forecasting for Solar Power Farms

Autor
Tiago Mourão Pires

Instituição
UP-FEP

2022

bio-signal analysis for neuromuscular control assessment: application to the stretch-shortening cycle in the human locomotion system

Autor
Carlos Manuel Barbosa Rodrigues

Instituição
UP-FEUP

2022

Towards Agile Requirements Management at Vodafone: a Reverse Engineering Approach

Autor
Maria Gonçalves Caldeira

Instituição
UP-FEUP

2022

Gait Analysis in Hereditary Amyloidosis Associated to Variant Transthyretin

Autor
Maria do Carmo Sousa Cardoso Vilas Boas de Olazabal

Instituição
UP-FEUP