Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by Pedro Ermida Monteiro

2019

Evaluation of different body tracking configurations in the sense of presence and embodiment

Authors
Correia, F; Goncalves, G; Monteiro, P; Coelho, H; Melo, M; Bessa, M;

Publication
PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON GRAPHICS AND INTERACTION (ICGI 2019)

Abstract
Innovations in virtual reality have boosted their use for business purposes and personal consumption. The main objective of this technology is to transport the user to virtual environments. The use of avatars to replace the user's body in these environments increases the levels of presence and embodiment of the user. Through the inverse kinematics it is possible to animate the avatars according to the data obtained in sensors scattered around the user's body, replicating the movements in a avatar. These sensors can vary in number offering different levels of fidelity in the tracking of the human body. In this paper, we study the impact of the number of sensors used in the presence of the user and in the embodiment of the avatar, using three, five and six tracking points. The results show that there is no statistically significant differences in presence nor in any of its sub-scale, however one can observe a positive trend in the 6-points conditions. As for embodiment, the results show that there is statistically signifficant differences in some of presence sub-scales, namelly tactile sensation, response and in the embodiment as a whole.

2021

Delivering Critical Stimuli for Decision Making in VR Training: Evaluation Study of a Firefighter Training Scenario

Authors
Monteiro, P; Melo, M; Valente, A; Vasconcelos Raposo, J; Bessa, M;

Publication
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS

Abstract
The goal for a virtual reality (VR) training system is to enable trainees to acquire all the knowledge they need to perform effectively in a real environment. Such a system should provide an experience so authentic that no further real-world training is necessary, meaning that it is sufficient to train in VR. We evaluate the impact of a haptic thermal stimulus, which is of paramount importance to decision making, on trainees performance and knowledge acquisition. A thermal device was created to deliver the stimulus. As a proof of concept, a procedure from firefighter training is selected, in which sensing the temperature of a door with one's hand is essential. The sample consisted of 48 subjects divided among three experimental scenarios: one in which a virtual thermometer is used (visual stimulus), another in which the temperature is felt with the hand (thermal stimulus) and a third in which both methods are used (visual + thermal stimuli). For the performance evaluation, we measured the total time taken, the numbers of correctly executed procedures and identified neutral planes, the deviation from the target height, and the responses to a knowledge transfer questionnaire. Presence, cybersickness, and usability are measured to evaluate the impact of the haptic thermal stimulus. Considering the thermal stimulus condition as the baseline, we conclude that the significantly different results in the performance among the conditions indicate that the better performance in the visual-only condition is not representative of the real-life performance. Consequently, VR training applications need to deliver the correct stimuli for decision making.

2021

Hands-free interaction in immersive virtual reality: A systematic review

Authors
Monteiro, P; Goncalves, G; Coelho, H; Melo, M; Bessa, M;

Publication
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS

Abstract
Hands are the most important tool to interact with virtual environments, and they should be available to perform the most critical tasks. For example, a surgeon in VR should keep his/her hands on the instruments and be able to do secondary tasks without performing a disruptive event to the operative task. In this common scenario, one can observe that hands are not available for interaction. The goal of this systematic review is to survey the literature and identify which hands-free interfaces are used, the performed interaction tasks, what metrics are used for interface evaluation, and the results of such evaluations. From 79 studies that met the eligibility criteria, the voice is the most studied interface, followed by the eye and head gaze. Some novel interfaces were brain interfaces and face expressions. System control and selection represent most of the interaction tasks studied and most studies evaluate interfaces for usability. Despite the best interface depending on the task and study, the voice was found to be versatile and showed good results amongst the studies. More research is recommended to improve the practical use of the interfaces and to evaluate the interfaces more formally.

2021

Systematic Review on Realism Research Methodologies on Immersive Virtual, Augmented and Mixed Realities

Authors
Goncalves, G; Monteiro, P; Coelho, H; Melo, M; Bessa, M;

Publication
IEEE ACCESS

Abstract
Proper evaluation of realism in immersive virtual experiences is crucial to ensure optimisation of resources. This way, we can take better decisions while designing realistic immersive experiences, prioritising factors that have a higher impact on the perceived realism of the virtual experience. This systematic review aims to provide readers with an overview of methodologies used throughout the literature to evaluate realism in immersive virtual, augmented and mixed reality. A total of 79 from 1300 gathered articles met the eligibility criteria and were analysed. Results have shown that virtual reality is by far the platform where realism studies were performed. Head-mounted displays are by far the preferred equipment for such studies. Visual realism is the most researched, followed by audiovisual. The majority of methodologies consisted of subjective, as well as a combination of objective and subjective measures. The most used evaluation instrument is questionnaires where many of which are custom and non-validated. Presence questionnaires are the most used ones and are often used to evaluate the presence, perceived realism and involvement. Cybersickness evaluation is consistently assessed by one self-report questionnaire.

2022

Do Multisensory Stimuli Benefit the Virtual Reality Experience? A Systematic Review

Authors
Melo, M; Goncalves, G; Monteiro, P; Coelho, H; Vasconcelos Raposo, J; Bessa, M;

Publication
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS

Abstract
The majority of virtual reality (VR) applications rely on audiovisual stimuli and do not exploit the addition of other sensory cues that could increase the potential of VR. This systematic review surveys the existing literature on multisensory VR and the impact of haptic, olfactory, and taste cues over audiovisual VR. The goal is to identify the extent to which multisensory stimuli affect the VR experience, which stimuli are used in multisensory VR, the type of VR setups used, and the application fields covered. An analysis of the 105 studies that met the eligibility criteria revealed that 84.8 percent of the studies show a positive impact of multisensory VR experiences. Haptics is the most commonly used stimulus in multisensory VR systems (86.6 percent). Non-immersive and immersive VR setups are preferred over semi-immersive setups. Regarding the application fields, a considerable part was adopted by health professionals and science and engineering professionals. We further conclude that smell and taste are still underexplored, and they can bring significant value to VR applications. More research is recommended on how to synthesize and deliver these stimuli, which still require complex and costly apparatus be integrated into the VR experience in a controlled and straightforward manner.

2021

Does gamification in virtual reality improve second language learning?

Authors
Pinto, RD; Monteiro, P; Melo, M; Cabral, L; Bessa, M;

Publication
International Conference on Graphics and Interaction, ICGI 2021, Porto, Portugal, November 4-5, 2021

Abstract
Previous works have shown the great potential of Virtual Reality (VR) in the area of Education. This paper studies if users can learn a second language when using a gamified VR application through an English learning test and how learning influences user satisfaction, sense of presence, cybersickness, and quality of experience through questionnaires. For this purpose, the VirtualeaRn game was developed. 20 Portuguese participants were exposed to the application, and the learning test was used before and after using the application. Result analysis shows an increase in learning results after using the VR gamified application, indicating the technology's efficacy in learning a second language. A positive user satisfaction, sense of presence, and quality of experience were also found. Some cases of cybersickness were reported. The outcomes are promising and provide enough information to show the potential of the gamification of VR technology for the area of learning a second language.

  • 2
  • 3