Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por HumanISE

2024

EVLearn: Extending the CityLearn Framework with Electric Vehicle Simulation

Autores
Fonseca, T; Ferreira, LL; Cabral, B; Severino, R; Nweye, K; Ghose, D; Nagy, Z;

Publicação
CoRR

Abstract
Intelligent energy management strategies, such as Vehicle-to-Grid (V2G) and Grid-to-Vehicle (V1G) emerge as a potential solution to the Electric Vehicles’ (EVs) integration into the energy grid. These strategies promise enhanced grid resilience and economic benefits for both vehicle owners and grid operators. Despite the announced perspective, the adoption of these strategies is still hindered by an array of operational problems. Key among these is the lack of a simulation platform that allows to validate and refine V2G and V1G strategies. Including the development, training, and testing in the context of Energy Communities (ECs) incorporating multiple flexible energy assets. Addressing this gap, first we introduce the EVLearn, an open-source extension for the existing CityLearn simulation framework. EVLearn provides both V2G and V1G energy management simulation capabilities into the study of broader energy management strategies of CityLearn by modeling EVs, their charging infrastructure and associated energy flexibility dynamics. Results validated the extension of CityLearn, where the impact of these strategies is highlighted through a comparative simulation scenario. © The Author(s) 2025.

2024

EnergAIze: Multi Agent Deep Deterministic Policy Gradient for Vehicle-to-Grid Energy Management

Autores
Fonseca, T; Ferreira, L; Cabral, B; Severino, R; Praça, I;

Publicação
2024 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CONTROL, AND COMPUTING TECHNOLOGIES FOR SMART GRIDS, SMARTGRIDCOMM 2024

Abstract
The rising adoption rates and integration of Renewable Energy Sources (RES) and Electric Vehicles (EVs) into the energy grid introduces complex challenges, including the need to balance supply and demand and smooth peak consumptions. Addressing these challenges requires innovative solutions such as Demand Response (DR), Renewable Energy Communities (RECs), and more specifically for EVs, Vehicle-to-Grid (V2G). However, existing V2G approaches often fall short in real-world applicability, adaptability, and user engagement. To bridge this gap, this paper proposes EnergAIze, a Multi-Agent Reinforcement Learning (MARL) energy management algorithm leveraging the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm. EnergAIze enables user-centric multi-objective energy management by allowing each prosumer to select from a range of personal management objectives. Additionally, it architects' data protection and ownership through decentralized deployment, where each prosumer can situate an energy management node directly at their own dwelling. The local node not only manages local EVs and other energy assets but also fosters REC wide optimization. EnergAIze is evaluated through a case study using the CityLearn framework. The results show reduction in peak loads, ramping, carbon emissions, and electricity costs at the REC level while optimizing for individual prosumers objectives.

2024

CityLearn v2: energy-flexible, resilient, occupant-centric, and carbon-aware management of grid-interactive communities

Autores
Nweye, K; Kaspar, K; Buscemi, G; Fonseca, T; Pinto, G; Ghose, D; Duddukuru, S; Pratapa, P; Li, H; Mohammadi, J; Ferreira, LL; Hong, TZ; Ouf, M; Capozzoli, A; Nagy, Z;

Publicação
JOURNAL OF BUILDING PERFORMANCE SIMULATION

Abstract
As more distributed energy resources become part of the demand-side infrastructure, quantifying their energy flexibility on a community scale is crucial. CityLearn v1 provided an environment for benchmarking control algorithms. However, there is no standardized environment utilizing realistic building-stock datasets for distributed energy resource control benchmarking without co-simulation or third-party frameworks. CityLearn v2 extends CityLearn v1 by providing a stand-alone simulation environment that leverages the End-Use Load Profiles for the U.S. Building Stock dataset to create grid-interactive communities for resilient, multi-agent, and objective control of distributed energy resources with dynamic occupant feedback. While the v1 environment used pre-simulated building thermal loads, the v2 environment uses data-driven thermal dynamics and eliminates the need for co-simulation with building energy performance software. This work details the v2 environment and provides application examples that use reinforcement learning control to manage battery energy storage system, vehicle-to-grid control, and thermal comfort during heat pump power modulation.

2024

The OPEVA Manifest: OPtimisation of Electrical Vehicle Autonomy, a Research and Innovation project

Autores
Kanak, A; Ergün, S; Arif, I; Ergün, SH; Bektas, C; Atalay, AS; Herkiloglu, O; Defossez, D; Yazici, A; Ferreira, LL; Strelec, M; Kubicek, K; Cech, M; Davoli, L; Belli, L; Ferrari, G; Bayar, D; Kafali, A; Karamavus, Y; Sofu, AM; Hartavi Karci, AE; Constant, P;

Publicação
Open Research Europe

Abstract
Electromobility is a critical component of Europe’s strategy to create a more sustainable society and support the European Green Transition while enhancing quality of life. Electrification also plays an important role in securing Europe’s position in the growing market of electric and autonomous vehicles (EAV). The EU-funded OPEVA project aims to take a big step towards deployment of sustainable electric vehicles by means of optimising their support in an ecosystem. Specifically, the project focuses on analysing and designing optimisation architecture, reducing battery charging time, and developing infrastructure, as well as reporting on the driver-oriented human factors. Overall, OPEVA’s goal is to enhance EAV market penetration and adoption, making them more accessible and convenient. The aim of this paper is to inform the European automotive, transportation, energy and mobility community be presenting the OPEVA manifestation, and the overall solution strategy solidified through the progress throughout the first year of the project.

2024

Multi-Agent Reinforcement Learning for Side-by-Side Navigation of Autonomous Wheelchairs

Autores
Fonseca, T; Leao, G; Ferreira, LL; Sousa, A; Severino, R; Reis, LP;

Publicação
2024 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
This paper explores the use of Robotics and decentralized Multi-Agent Reinforcement Learning (MARL) for side-by-side navigation in Intelligent Wheelchairs (IW). Evolving from a previous work approach using traditional single-agent methodologies, it adopts a Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm to provide control input and enable a pair of IW to be deployed as decentralized computing agents in real-world environments, discarding the need to rely on communication between each other. In this study, the Flatland 2D simulator, in conjunction with the Robot Operating System (ROS), is used as a realistic environment to train and test the navigation algorithm. An overhaul of the reward function is introduced, which now provides individual rewards for each agent and revised reward incentives. Additionally, the logic for identifying side-by-side navigation was improved, to encourage dynamic alignment control. The preliminary results outline a promising research direction, with the IWs learning to navigate in various realistic hallways testing scenarios. The outcome also suggests that while the MADDPG approach holds potential over single-agent techniques for the decentralized IW robotics application, further investigation are needed for real-world deployment.

2024

Real-Time Parallel Programming for Homogeneous Multicores

Autores
Pinho, LM;

Publicação
2024 IEEE 14TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL EMBEDDED SYSTEMS, SIES

Abstract
Developing real-time systems applications requires programming paradigms that can handle the specification of concurrent activities and timing constraints, and controlling execution on a particular platform. The increasing need for high-performance, and the use of fine-grained parallel execution, makes this an even more challenging task. This paper explores the state-of-the-art and challenges in real-time parallel application development, focusing on two research directions: one from the high- performance domain (using OpenMP) and another from the real-time and critical systems field (based on Ada). The paper reviews the features of each approach and highlights remaining open issues.

  • 90
  • 700