Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

2023

A Review on Deep Learning-Based Automatic Lipreading

Authors
Santos, C; Cunha, A; Coelho, P;

Publication
Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST

Abstract
Automatic Lip-Reading (ALR), also known as Visual Speech Recognition (VSR), is the technological process to extract and recognize speech content, based solely on the visual recognition of the speaker’s lip movements. Besides hearing-impaired people, regular hearing people also resort to visual cues for word disambiguation, every time one is in a noisy environment. Due to the increasingly interest in developing ALR systems, a considerable number of research articles are being published. This article selects, analyses, and summarizes the main papers from 2018 to early 2022, from traditional methods with handcrafted feature extraction algorithms to end-to-end deep learning based ALR which fully take advantage of learning the best features, and of the evergrowing publicly available databases. By providing a recent state-of-the-art overview, identifying trends, and presenting a conclusion on what is to be expected in future work, this article becomes an efficient way to update on the most relevant ALR techniques. © 2023, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.

2023

Text2Storyline: Generating Enriched Storylines from Text

Authors
Gonçalves, F; Campos, R; Jorge, A;

Publication
ADVANCES IN INFORMATION RETRIEVAL, ECIR 2023, PT III

Abstract
In recent years, the amount of information generated, consumed and stored has grown at an astonishing rate, making it difficult for those seeking information to extract knowledge in good time. This has become even more important, as the average reader is not as willing to spare more time out of their already busy schedule as in the past, thus prioritizing news in a summarized format, which are faster to digest. On top of that, people tend to increasingly rely on strong visual components to help them understand the focal point of news articles in a less tiresome manner. This growing demand, focused on exploring information through visual aspects, urges the need for the emergence of alternative approaches concerned with text understanding and narrative exploration. This motivated us to propose Text2Storyline, a platform for generating and exploring enriched storylines from an input text, a URL or a user query. The latter is to be issued on the PortugueseWebArchive (Arquivo.pt), therefore giving users the chance to expand their knowledge and build up on information collected from web sources of the past. To fulfill this objective, we propose a system that makes use of the TimeMatters algorithm to filter out non-relevant dates and organize relevant content by means of different displays: `Annotated Text', `Entities', `Storyline', `Temporal Clustering' and `Word Cloud'. To extend the users' knowledge, we rely on entity linking to connect persons, events, locations and concepts found in the text to Wikipedia pages, a process also known as Wikification. Each of the entities is then illustrated by means of an image collected from the Arquivo.pt.

2023

FALQU: Finding Answers to Legal Questions

Authors
Mansouri, B; Campos, R;

Publication
CoRR

Abstract

2023

Erbium-doped fiber ring cavity assisted by an FBG and PS-FBG reflector for refractive-index measurements - INVITED

Authors
Perez-Herrera, RA; Diaz, H; Soares, L; Novais, S; Lopez-Amo, M; Silva, S; Frazão, O;

Publication
EPJ Web of Conferences

Abstract
This work presents an interrogator system based on an erbium-doped fiber ring cavity for refractive-index measurements. This fiber ring cavity is assisted by a fiber Bragg grating and a phase-shift fiber Bragg grating, both with a similar central emission wavelength to increase the output power levels.

2023

Evaluating Rotation Invariant Strategies for Mitosis Detection Through YOLO Algorithms

Authors
Gonzalez, DG; Carias, J; Castilla, YC; Rodrigues, J; Adão, T; Jesus, R; Magalhães, LGM; de Sousa, VML; Carvalho, L; Almeida, R; Cunha, A;

Publication
Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST

Abstract
Cancer diagnosis is of major importance in the field of human medical pathology, wherein a cell division process known as mitosis constitutes a relevant biological pattern analyzed by professional experts, who seek for such occurrence in presence and number through visual observation of microscopic imagery. This is a time-consuming and exhausting task that can benefit from modern artificial intelligence approaches, namely those handling object detection through deep learning, from which YOLO can be highlighted as one of the most successful, and, as such, a good candidate for performing automatic mitoses detection. Considering that low sensibility for rotation/flip variations is of high importance to ensure mitosis deep detection robustness, in this work, we propose an offline augmentation procedure focusing rotation operations, to address the impact of lost/clipped mitoses induced by online augmentation. YOLOv4 and YOLOv5 were compared, using an augmented test dataset with an exhaustive set of rotation angles, to investigate their performance. YOLOv5 with a mixture of offline and online rotation augmentation methods presented the best averaged F1-score results over three runs. © 2023, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.

2023

Text Mining and Visualization of Political Party Programs Using Keyword Extraction Methods: The Case of Portuguese Legislative Elections

Authors
Campos, R; Jatowt, A; Jorge, A;

Publication
iConference (1)

Abstract
Extracting keywords from textual data is a crucial step for text analysis. One such process may involve a considerable amount of time when done manually. In this paper, we show how keyword extraction techniques can be used to untap texts of political nature. To accomplish this objective, we conduct a case-study on top of 16 Portuguese (PT) political party programs made available in the context of the legislative elections that took place in 30th of January 2022. Our contributions are two-fold. At the level of resources, we make available a curated dataset and a python notebook that systematizes the process of transforming text into quantitative data and into visual aspects. At the methodological level, we propose to extend the keyword extraction algorithm used in this study to extract the most relevant keywords, not only from individual political party programs, but also across the entire collection of documents. A further contribution is the case-study itself, which calls attention to the fact that such solutions may be of interest not only to common people, but also to journalists or politicians alike. Broadly, we demonstrate how the discussion and the analysis that stems from the results obtained may foster the political science research by making available large-scale processing of documents with marginal costs.

  • 670
  • 4519