2023
Autores
Santos, C; Cunha, A; Coelho, P;
Publicação
Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Abstract
Automatic Lip-Reading (ALR), also known as Visual Speech Recognition (VSR), is the technological process to extract and recognize speech content, based solely on the visual recognition of the speaker’s lip movements. Besides hearing-impaired people, regular hearing people also resort to visual cues for word disambiguation, every time one is in a noisy environment. Due to the increasingly interest in developing ALR systems, a considerable number of research articles are being published. This article selects, analyses, and summarizes the main papers from 2018 to early 2022, from traditional methods with handcrafted feature extraction algorithms to end-to-end deep learning based ALR which fully take advantage of learning the best features, and of the evergrowing publicly available databases. By providing a recent state-of-the-art overview, identifying trends, and presenting a conclusion on what is to be expected in future work, this article becomes an efficient way to update on the most relevant ALR techniques. © 2023, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
2023
Autores
Gonçalves, F; Campos, R; Jorge, A;
Publicação
ADVANCES IN INFORMATION RETRIEVAL, ECIR 2023, PT III
Abstract
In recent years, the amount of information generated, consumed and stored has grown at an astonishing rate, making it difficult for those seeking information to extract knowledge in good time. This has become even more important, as the average reader is not as willing to spare more time out of their already busy schedule as in the past, thus prioritizing news in a summarized format, which are faster to digest. On top of that, people tend to increasingly rely on strong visual components to help them understand the focal point of news articles in a less tiresome manner. This growing demand, focused on exploring information through visual aspects, urges the need for the emergence of alternative approaches concerned with text understanding and narrative exploration. This motivated us to propose Text2Storyline, a platform for generating and exploring enriched storylines from an input text, a URL or a user query. The latter is to be issued on the PortugueseWebArchive (Arquivo.pt), therefore giving users the chance to expand their knowledge and build up on information collected from web sources of the past. To fulfill this objective, we propose a system that makes use of the TimeMatters algorithm to filter out non-relevant dates and organize relevant content by means of different displays: `Annotated Text', `Entities', `Storyline', `Temporal Clustering' and `Word Cloud'. To extend the users' knowledge, we rely on entity linking to connect persons, events, locations and concepts found in the text to Wikipedia pages, a process also known as Wikification. Each of the entities is then illustrated by means of an image collected from the Arquivo.pt.
2023
Autores
Mansouri, B; Campos, R;
Publicação
CoRR
Abstract
2023
Autores
Perez-Herrera, RA; Diaz, H; Soares, L; Novais, S; Lopez-Amo, M; Silva, S; Frazão, O;
Publicação
EPJ Web of Conferences
Abstract
2023
Autores
Gonzalez, DG; Carias, J; Castilla, YC; Rodrigues, J; Adão, T; Jesus, R; Magalhães, LGM; de Sousa, VML; Carvalho, L; Almeida, R; Cunha, A;
Publicação
Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Abstract
Cancer diagnosis is of major importance in the field of human medical pathology, wherein a cell division process known as mitosis constitutes a relevant biological pattern analyzed by professional experts, who seek for such occurrence in presence and number through visual observation of microscopic imagery. This is a time-consuming and exhausting task that can benefit from modern artificial intelligence approaches, namely those handling object detection through deep learning, from which YOLO can be highlighted as one of the most successful, and, as such, a good candidate for performing automatic mitoses detection. Considering that low sensibility for rotation/flip variations is of high importance to ensure mitosis deep detection robustness, in this work, we propose an offline augmentation procedure focusing rotation operations, to address the impact of lost/clipped mitoses induced by online augmentation. YOLOv4 and YOLOv5 were compared, using an augmented test dataset with an exhaustive set of rotation angles, to investigate their performance. YOLOv5 with a mixture of offline and online rotation augmentation methods presented the best averaged F1-score results over three runs. © 2023, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
2023
Autores
Campos, R; Jatowt, A; Jorge, A;
Publicação
iConference (1)
Abstract
Extracting keywords from textual data is a crucial step for text analysis. One such process may involve a considerable amount of time when done manually. In this paper, we show how keyword extraction techniques can be used to untap texts of political nature. To accomplish this objective, we conduct a case-study on top of 16 Portuguese (PT) political party programs made available in the context of the legislative elections that took place in 30th of January 2022. Our contributions are two-fold. At the level of resources, we make available a curated dataset and a python notebook that systematizes the process of transforming text into quantitative data and into visual aspects. At the methodological level, we propose to extend the keyword extraction algorithm used in this study to extract the most relevant keywords, not only from individual political party programs, but also across the entire collection of documents. A further contribution is the case-study itself, which calls attention to the fact that such solutions may be of interest not only to common people, but also to journalists or politicians alike. Broadly, we demonstrate how the discussion and the analysis that stems from the results obtained may foster the political science research by making available large-scale processing of documents with marginal costs.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.