2023
Autores
Costa, TS; Viana, P; Andrade, MT;
Publicação
IEEE ACCESS
Abstract
Quality of Experience (QoE) in multi-view streaming systems is known to be severely affected by the latency associated with view-switching procedures. Anticipating the navigation intentions of the viewer on the multi-view scene could provide the means to greatly reduce such latency. The research work presented in this article builds on this premise by proposing a new predictive view-selection mechanism. A VGG16-inspired Convolutional Neural Network (CNN) is used to identify the viewer's focus of attention and determine which views would be most suited to be presented in the brief term, i.e., the near-term viewing intentions. This way, those views can be locally buffered before they are actually needed. To this aim, two datasets were used to evaluate the prediction performance and impact on latency, in particular when compared to the solution implemented in the previous version of our multi-view streaming system. Results obtained with this work translate into a generalized improvement in perceived QoE. A significant reduction in latency during view-switching procedures was effectively achieved. Moreover, results also demonstrated that the prediction of the user's visual interest was achieved with a high level of accuracy. An experimental platform was also established on which future predictive models can be integrated and compared with previously implemented models.
2023
Autores
da Costa, TS; Andrade, MT; Viana, P; Silva, NC;
Publicação
PROCEEDINGS OF THE 2023 PROCEEDINGS OF THE 14TH ACM MULTIMEDIA SYSTEMS CONFERENCE, MMSYS 2023
Abstract
Immersive video applications impose unpractical bandwidth requirements for best-effort networks. With Multi-View(MV) streaming, these can be minimized by resorting to view prediction techniques. SmoothMV is a multi-view system that uses a non-intrusive head tracking mechanism to detect the viewer's interest and select appropriate views. By coupling Neural Networks (NNs) to anticipate the viewer's interest, a reduction of view-switching latency is likely to be obtained. The objective of this paper is twofold: 1) Present a solution for acquisition of gaze data from users when viewing MV content; 2) Describe a dataset, collected with a large-scale testbed, capable of being used to train NNs to predict the user's viewing interest. Tracking data from head movements was obtained from 45 participants using an Intel Realsense F200 camera, with 7 video playlists, each being viewed a minimum of 17 times. This dataset is publicly available to the research community and constitutes an important contribution to reducing the current scarcity of such data. Tools to obtain saliency/heat maps and generate complementary plots are also provided as an open-source software package.
1993
Autores
LEAL, F; OLIVEIRA, C; SILVA, J; VIANA, P; CARRAPATOSO, E;
Publicação
VIDEO COMMUNICATIONS AND PACS FOR MEDICAL APPLICATIONS
Abstract
This contribution describes a Videotex terminal with photographic capabilities based on a personal computer (PC). This system takes advantage of a recently available support - the Integrated Services Digital Network (ISDN) - which represents a significant improvement in the performance of communication systems, and is intended to offer a new and practical service while maintaining compatibility with the Alphamosaic Videotex.
1993
Autores
Leal, F; Oliveira, C; Silva, JA; Viana, P; Carrapatoso, E;
Publicação
Video Communications and PACS for Medical Applications
Abstract
1997
Autores
Loftus, C; Sherratt, E; Inocencio, E; Viana, P;
Publicação
SDL '97 - TIME FOR TESTING: SDL, MSC AND TRENDS
Abstract
Like many other subjects, SDL is embroiled in the fusion of the Telecom and Information systems worlds. This represents a shift from the predominant use of SDL in relatively closed Telecom areas to the more and more widely used open distributed processing environments. ACTS project AC227, SCREEN, is working to improve the creation of distributed telematic services. This paper presents some of the issues and challenges that these new environments present to SDL language, and the rationale for combing SDL with OMT and the targeting to CORBA compliant environments.
2000
Autores
Viana, P; Alves, AP;
Publicação
Internet Multimedia Management Systems
Abstract
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.