Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por Catarina Moreira Marques

2024

Deep Reinforcement Learning-Based Approach to Dynamically Balance Multi-manned Assembly Lines

Autores
Santos, R; Marques, C; Toscano, C; Ferreira, HM; Ribeiro, J;

Publicação
FLEXIBLE AUTOMATION AND INTELLIGENT MANUFACTURING: ESTABLISHING BRIDGES FOR MORE SUSTAINABLE MANUFACTURING SYSTEMS, FAIM 2023, VOL 1

Abstract
Assembly lines are at the core of many manufacturing systems, and planning for a well-balanced flow is key to ensure long-term efficiency. However, in flexible configurations such as Multi-Manned Assembly Lines (MMAL), the balancing problem also becomes more challenging. Due to the increased relevance of these assembly lines, this work aims to investigate the MMAL balancing problem, to contribute for a more effective decision-making process. Therefore, a new approach is proposed based on Deep Reinforcement Learning (DRL) embedded in a Digital Twin architecture. The proposed approach provides a close-to-reality training environment for the agent, using Discrete Event Simulation to simulate the production system dynamics. This methodology was tested on a real-world instance with preliminary results showing that similar solutions to the ones obtained using optimization-based strategies are achieved. This research provides evidence of success in terms of dynamic resource assignment to tasks and workers as a basis for future developments.

2022

Supply Chain Resiliency in the Pharmaceutical Industry – a Simulation-Based Approach

Autores
da Silva, ACT; de Sousa, JP; Marques, CM;

Publicação
Proceedings of the International Conference on Industrial Engineering and Operations Management

Abstract

2023

A Simulation Approach for the Design of More Sustainable and Resilient Supply Chains in the Pharmaceutical Industry

Autores
Silva, AC; Marques, CM; de Sousa, JP;

Publicação
SUSTAINABILITY

Abstract
In a world facing unprecedented challenges, such as climate changes and growing social problems, the pharmaceutical industry must ensure that its supply chains are environmentally sustainable and resilient, guaranteeing access to key medications even when faced with unanticipated disruptions or crises. The core goal of this work is to develop an innovative simulation-based approach to support more informed and effective decision making, while establishing reasonable trade-offs between supply chain robustness and resiliency, operational efficiency, and environmental and social concerns. Such a decision-support system will contribute to the development of more resilient and sustainable pharmaceutical supply chains, which are, in general, critical for maintaining access to essential medicines, especially during times of crises or relevant disruptions. The system will help companies to better manage and design their supply chains, providing a valuable tool to achieve higher levels of resilience and sustainability. The study we conducted has two primary contributions that are noteworthy. Firstly, we present a new advanced approach that integrates multiple simulation techniques, allowing for the modeling of highly complex environments. Secondly, we introduce a new conceptual framework that helps to comprehend the interplay between resiliency and sustainability in decision-making processes. These two contributions provide valuable insights into understanding complex systems and can aid in designing more resilient and sustainable systems.

2026

Enhancing picking-by-line operations: a simulation-based approach

Autores
Silva, AC; Santos, R; Senna, PP; Borges, FM; Marques, CM;

Publicação
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY

Abstract
Effective warehouse management plays a pivotal role in optimizing supply chain performance, particularly in high-demand, time-sensitive environments. This study introduces a simulation-based decision support system designed to improve the management of Picking-By-Line (PBL) operations in cross-docking distribution centres. Developed in FlexSim and calibrated with empirical data from an industrial case study, the model replicates real-world warehouse conditions and is validated against observed operational performance. The tool supports warehouse managers in evaluating and comparing operational strategies, such as dynamic storage allocation policies and picker routing constraints, with the goal of reducing operator travel distances, mitigating congestion, and enhancing overall efficiency. A key contribution of this work is the integration of congestion-sensitive performance indicators that allow for a detailed analysis of the trade-offs between travel efficiency and localized congestion-an aspect often overlooked in traditional optimization methods. This study demonstrates the value of simulation as a scalable and realistic decision-support tool for optimizing PBL operations in complex and variable environments where human movement is a major cost and performance driver. The proposed tool bridges the gap between theoretical modelling and practical implementation, offering actionable insights for warehouse layout, space utilization, and resource allocation.

2026

Enhancing multi-agent deep reinforcement learning for flexible job-shop scheduling through constraint programming

Autores
Jesus, A; Corrêa, A; Vieira, M; Marques, C; Silva, C; Moniz, S;

Publicação
COMPUTERS & OPERATIONS RESEARCH

Abstract
This paper introduces PRISMA, a hybrid multi-agent Deep Reinforcement Learning (DRL) framework for solving the Flexible Job-shop Scheduling Problem (FJSP). It uses Constraint Programming (CP) solutions to pretrain decentralized policies and to guide exploration during training. Although DRL can generate fast solutions for large combinatorial problems, it often fails to match the quality of optimization methods, motivating the integration with hybrid frameworks. The growing interest in embedding domain knowledge into learning algorithms has produced several hybrid formulations, yet their potential remains underexplored, particularly in multi-agent settings. PRISMA combines supervised and reinforcement learning within a multi-agent framework, where CP solutions are used to (i) learn expert decisions through imitation learning, and (ii) train an auxiliary network that guides DRL training via reward shaping. A shared graph network is adopted for transferring system-level knowledge into machine-level observations, enabling fast and consistent inference from enriched local embed-dings. To the best of our knowledge, PRISMA introduces the first expert-derived guidance mechanism for the FJSP and is among the earliest to apply imitation learning within a multi-agent formulation. By combining both modules, it strengthens the bridge between optimization and learning-based methods, where such dual integrations remain scarce. Experimental results show faster convergence and higher solution quality than state-ofthe-art DRL models. PRISMA achieves an average optimality gap of 6.74%, corresponding to a 50% relative improvement over the single-agent baseline, while reducing inference time. These findings reinforce the value of merging optimization accuracy with the flexibility of multi-agent DRL for efficient scheduling.

  • 3
  • 3