Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por CEGI

2022

A multi-head attention-based transformer model for traffic flow forecasting with a comparative analysis to recurrent neural networks

Autores
Reza, S; Ferreira, MC; Machado, JJM; Tavares, JMRS;

Publicação
EXPERT SYSTEMS WITH APPLICATIONS

Abstract
Traffic flow forecasting is an essential component of an intelligent transportation system to mitigate congestion. Recurrent neural networks, particularly gated recurrent units and long short-term memory, have been the stateof-the-art traffic flow forecasting models for the last few years. However, a more sophisticated and resilient model is necessary to effectively acquire long-range correlations in the time-series data sequence under analysis. The dominant performance of transformers by overcoming the drawbacks of recurrent neural networks in natural language processing might tackle this need and lead to successful time-series forecasting. This article presents a multi-head attention based transformer model for traffic flow forecasting with a comparative analysis between a gated recurrent unit and a long-short term memory-based model on PeMS dataset in this context. The model uses 5 heads with 5 identical layers of encoder and decoder and relies on Square Subsequent Masking techniques. The results demonstrate the promising performance of the transform-based model in predicting long-term traffic flow patterns effectively after feeding it with substantial amount of data. It also demonstrates its worthiness by increasing the mean squared errors and mean absolute percentage errors by (1.25 - 47.8)% and (32.4 - 83.8)%, respectively, concerning the current baselines.

2022

A customized residual neural network and bi-directional gated recurrent unit-based automatic speech recognition model

Autores
Reza, S; Ferreira, MC; Machado, JJM; Tavares, JMRS;

Publicação
EXPERT SYSTEMS WITH APPLICATIONS

Abstract
Speech recognition aims to convert human speech into text and has applications in security, healthcare, commerce, automobiles, and technology, just to name a few. Inserting residual neural networks before recurrent neural network cells improves accuracy and cuts training time by a good margin. Furthermore, layer normalization instead of batch normalization is more effective in model training and performance enhancement. Also, the size of the datasets presents tremendous influences in achieving the best performance. Leveraging these tricks, this article proposes an automatic speech recognition model with a stacked five layers of customized Residual Convolution Neural Network and seven layers of Bi-Directional Gated Recurrent Units, including a logarithmic so f tmax for the model output. Each of them incorporates a learnable per-element affine parameter-based layer normalization technique. The training and testing of the new model were conducted on the LibriSpeech corpus and LJ Speech dataset. The experimental results demonstrate a character error rate (CER) of 4.7 and 3.61% on the two datasets, respectively, with only 33 million parameters without the requirement of any external language model.

2022

New models and methods for the Vehicle Routing Problem with Multiple Synchronisation Constraints

Autores
Ricardo Filipe Ferreira Soares;

Publicação

Abstract

2022

The impact of time windows constraints on metaheuristics implementation: a study for the Discrete and Dynamic Berth Allocation Problem

Autores
Barbosa, F; Rampazzo, PCB; de Azevedo, AT; Yamakami, A;

Publicação
APPLIED INTELLIGENCE

Abstract
This paper describes the development of a mechanism to deal with time windows constraints. To the best of our knowledge, the time windows constraints are difficult to be fulfilled even for state-of-the-art methods. Therefore, the main contribution of this paper is to propose a new computational technique to deal with such constraints to ensure the algorithm convergence. We test such technique in two metaheuristics to solve the discrete and dynamic Berth Allocation Problem. A data set generator was created, resulting in a diversity of problems in terms of time windows constraints. A detailed computational analysis was carried out to compare the performance for each metaheuristic.

2022

The rectangular two-dimensional strip packing problem real-life practical constraints: A bibliometric overview

Autores
Neuenfeldt, A; Silva, E; Francescatto, M; Rosa, CB; Siluk, J;

Publicação
COMPUTERS & OPERATIONS RESEARCH

Abstract
Over the years, methods and algorithms have been extensively studied to solve variations of the rectangular twodimensional strip packing problem (2D-SPP), in which small rectangles must be packed inside a larger object denominated as a strip, while minimizing the space necessary to pack all rectangles. In the rectangular 2D-SPP, constraints are used to restrict the packing process, satisfying physical and real-life practical conditions that can impact the material cutting. The objective of this paper is to present an extensive literature review covering scientific publications about the rectangular 2D-SPP constraints in order to provide a useful foundation to support new research works. A systematic literature review was conducted, and 223 articles were selected and analyzed. Real-life practical constraints concerning the rectangular 2D-SPP were classified into seven different groups. In addition, a bibliometric analysis of the rectangular 2D-SPP academic literature was developed. The most relevant authors, articles, and journals were discussed, and an analysis made concerning the basic constraints (orientation and guillotine cutting) and the main solving methods for the rectangular 2D-SPP. Overall, the present paper indicates opportunities to address real-life practical constraints.

2022

Recommendation Tool for Use of Immersive Learning Environments

Autores
Morgado, L; Torres, M; Beck, D; Torres, F; Almeida, A; Simões, A; Ramalho, F; Coelho, A;

Publicação
8th International Conference of the Immersive Learning Research Network, iLRN 2022, Vienna, Austria, May 30 - June 4, 2022

Abstract
In the field of immersive learning, instructors often find it challenging to match their pedagogical approaches and content knowledge with specific technologies. Unfortunately, this usually results in either a lack of technology use or inappropriate use of some technologies. Teachers and trainers wishing to use immersive learning environments face a diversity of technological and pedagogical alternatives. To scaffold educators in their planning of immersive learning educational activities, we devised a recommendation tool, which maps educational context variables to the dimensions of immersion and uses educators' contexts to identify the closest educational uses. Sample educational activities for those uses are then presented, for various types of educational methodologies. Educators can use these samples to plan their educational activities in line with their current resources or to innovate by pursuing entirely different approaches.

  • 50
  • 192