Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por LIAAD

2022

Censored Multivariate Linear Regression Model

Autores
Sousa, R; Pereira, I; Silva, ME;

Publicação
RECENT DEVELOPMENTS IN STATISTICS AND DATA SCIENCE, SPE2021

Abstract
Often, real-life problems require modelling several response variables together. This work analyses a multivariate linear regression model when the data are censored. Censoring distorts the correlation structure of the underlying variables and increases the bias of the usual estimators. Thus, we propose three methods to deal with multivariate data under left censoring, namely Expectation Maximization (EM), DataAugmentation (DA) and Gibbs Sampler with Data Augmentation (GDA). Results from a simulation study showthat both DA and GDA estimates are consistent for low and moderate correlation. Under high correlation scenarios, EM estimates present a lower bias.

2022

Statistical education and official statistics - training future data scientists

Autores
Silva, ME; Campos, P;

Publicação
Proceedings of the IASE 2021 Satellite Conference

Abstract
EMOS (The European Master in Official Statistics) was set up to strengthen the collaboration within academia and producers of official statistics and help develop professionals able to work with European official data at different levels in the fast-changing production system of the 21st century. In this paper we address the need for training in Official Statistics, particularly in current times, where new skill sets and competencies are necessary. In particular, the needs for new data sources currently used by national statistical systems require the development of new methodologies. For that purpose, we do a matching between National Statistical Offices (NSO) needs and the offer from universities.

2022

NER in Archival Finding Aids: Extended

Autores
Cunha, LFD; Ramalho, JC;

Publicação
MACHINE LEARNING AND KNOWLEDGE EXTRACTION

Abstract
The amount of information preserved in Portuguese archives has increased over the years. These documents represent a national heritage of high importance, as they portray the country's history. Currently, most Portuguese archives have made their finding aids available to the public in digital format, however, these data do not have any annotation, so it is not always easy to analyze their content. In this work, Named Entity Recognition solutions were created that allow the identification and classification of several named entities from the archival finding aids. These named entities translate into crucial information about their context and, with high confidence results, they can be used for several purposes, for example, the creation of smart browsing tools by using entity linking and record linking techniques. In order to achieve high result scores, we annotated several corpora to train our own Machine Learning algorithms in this context domain. We also used different architectures, such as CNNs, LSTMs, and Maximum Entropy models. Finally, all the created datasets and ML models were made available to the public with a developed web platform, NER@DI.

2022

NER in Archival Finding Aids: Next Level

Autores
Cunha, LFD; Ramalho, JC;

Publicação
INFORMATION SYSTEMS AND TECHNOLOGIES, WORLDCIST 2022, VOL 2

Abstract
Currently, there is a vast amount of archival finding aids in Portuguese archives, however, these documents lack structure (are not annotated) making them hard to process and work with. In this way, we intend to extract and classify entities of interest, like geographical locations, people's names, dates, etc. For this, we will use an architecture that has been revolutionizing several NLP tasks, Transformers, presenting several models in order to achieve high results. It is also intended to understand what will be the degree of improvement that this new mechanism will present in comparison with previous architectures. Can Transformer-based models replace the LSTMs in NER? We intend to answer this question along this paper.

2022

Fine-Tuning BERT Models to Extract Named Entities from Archival Finding Aids

Autores
Costa Cunha, LF; Ramalho, JC;

Publicação
Proceedings of the 26th International Conference on Theory and Practice of Digital Libraries - Workshops and Doctoral Consortium, Padua, Italy, September 20, 2022.

Abstract
In recent works, several NER models were developed to extract named entities from Portuguese Archival Finding Aids. In this paper, we are complementing the work already done by presenting a different NER model with a new architecture, Bidirectional Encoding Representation from Transformers (BERT). In order to do so, we used a BERT model that was pre-trained in Portuguese vocabulary and fine-tuned it to our concrete classification problem, NER. In the end, we compared the results obtained with previous architectures. In addition to this model we also developed an annotation tool that uses ML models to speed up the corpora annotation process. © 2022 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0)

2022

Reasoning with Portuguese Word Embeddings

Autores
Costa Cunha, LF; Almeida, JJ; Simões, A;

Publicação
11th Symposium on Languages, Applications and Technologies, SLATE 2022, July 14-15, 2022, Universidade da Beira Interior, Covilhã, Portugal.

Abstract
Representing words with semantic distributions to create ML models is a widely used technique to perform Natural Language processing tasks. In this paper, we trained word embedding models with different types of Portuguese corpora, analyzing the influence of the models’ parameterization, the corpora size, and domain. Then we validated each model with the classical evaluation methods available: four words analogies and measurement of the similarity of pairs of words. In addition to these methods, we proposed new alternative techniques to validate word embedding models, presenting new resources for this purpose. Finally, we discussed the obtained results and argued about some limitations of the word embedding models’ evaluation methods. © Luís Filipe Cunha, J. João Almeida, and Alberto Simões.

  • 111
  • 504