Abstract
This paper explores the use of Robotics and decentralized Multi-Agent Reinforcement Learning (MARL) for side-by-side navigation in Intelligent Wheelchairs (IW). Evolving from a previous work approach using traditional single-agent methodologies, it adopts a Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm to provide control input and enable a pair of IW to be deployed as decentralized computing agents in real-world environments, discarding the need to rely on communication between each other. In this study, the Flatland 2D simulator, in conjunction with the Robot Operating System (ROS), is used as a realistic environment to train and test the navigation algorithm. An overhaul of the reward function is introduced, which now provides individual rewards for each agent and revised reward incentives. Additionally, the logic for identifying side-by-side navigation was improved, to encourage dynamic alignment control. The preliminary results outline a promising research direction, with the IWs learning to navigate in various realistic hallways testing scenarios. The outcome also suggests that while the MADDPG approach holds potential over single-agent techniques for the decentralized IW robotics application, further investigation are needed for real-world deployment.

Abstract
Robot Learning is one of the most important areas in Robotics and its relevance has only been increasing. The Robot Operating System (ROS) has been one of the most used architectures in Robotics but learning it is not a simple task. Additionally, ROS 1 is reaching its end-of-life and a lot of users are yet to make the transition to ROS 2. Reinforcement Learning (RL) and Robotics are rarely taught together, creating greater demand for tools to teach all these components. This paper aims to develop a learning kit that can be used to teach Robot Learning to students with different levels of expertise in Robotics. This kit works with the Flatland simulator using open-source free software, namely the OpenAI Gym and Stable-Baselines3 packages, and contains tutorials that introduce the user to the simulation environment as well as how to use RL to train the robot to perform different tasks. User tests were conducted to better understand how the kit performs, showing very positive feedback, with most participants agreeing that the kit provided a productive learning experience.

Abstract
Reinforcement Learning (RL) is a well-suited paradigm to train robots since it does not require any previous information or database to train an agent. This paper explores using Deep Reinforcement Learning (DRL) to train a robot to navigate in maps containing different sorts of obstacles and which emulate hallways. Training and testing were performed using the Flatland 2D simulator and a Deep Q-Network (DQN) provided by OpenAI gym. Different sets of maps were used for training and testing. The experiments illustrate how well the robot is able to navigate in maps distinct from the ones used for training by learning new behaviours (namely following walls) and highlight the key challenges when solving this task using DRL, including the appropriate definition of the state space and reward function, as well as of the stopping criteria during training.

Abstract
Microscopic simulation requires accurate car-following models so that they can properly emulate real-world traffic. In order to define these models, calibration procedures can be used. The main problem with reliable calibration methods is their high cost, either in terms of the time they need to produce a model or due to high resource requirements. In this paper, we examine a method based on virtual driving simulation to calibrate the Krauß car-following model by coupling the Unity 3D game engine with SUMO. In addition, we present a means based on the fundamental diagrams of traffic flow for validating the instances of the model obtained from the calibration. The results show that our method is capable of producing instances with parameters close to those found in the literature. We conclude that this method is a promising, cost-efficient calibration technique for the Krauß model. Further investigation will be required to define a more general approach to calibrate a broader range of car-following models and to improve their accuracy. © 2019 EUROSIS-ETI.

Abstract
Bin picking is a challenging problem that involves using a robotic manipulator to remove, one-by-one, a set of objects randomly stacked in a container. When the objects are prone to entanglement, having an estimation of their pose and shape is highly valuable for more reliable grasp and motion planning. This paper focuses on modeling entangled tubes with varying degrees of curvature. An unconventional machine learning technique, Inductive Logic Programming (ILP), is used to construct sets of rules (theories) capable of modeling multiple tubes when given the cylinders that constitute them. Datasets of entangled tubes are created via simulation in Gazebo. Experiments using Aleph and SWI-Prolog illustrate how ILP can build explainable theories with a high performance, using a relatively small dataset and low amount of time for training. Therefore, this work serves as a proof-of-concept that ILP is a valuable method to acquire knowledge and validate heuristics for pose and shape estimation in complex bin picking scenarios.

Abstract
Robotics is an ever-growing field, used in countless applications, from domestic to industrial, and taught in advanced courses of multiple higher education institutions. Robot Operating System (ROS), the most prominent robotics architecture, integrates several of these, and has recently moved to a new iteration in the form of ROS2. This project aims to design a complete educational package meant for teaching intelligent robotics in ROS1 and ROS2. A foundation for the package was constructed, using a small differential drive robot equipped with camera-based virtual sensors, a representation in the Flatland simulator, and introductory lessons to both ROS versions and Reinforcement Learning (RL) in robotics. To evaluate the package's pertinence, expected learning outcomes were set and the lessons were tested with users from varying backgrounds and levels of robotics experience. Encouraging results were obtained, especially in the ROS1 and ROS2 lessons, while the feedback from the RL lesson provided clear indications for future improvements. Therefore, this work provides solid groundwork for a more comprehensive educational package on robotics and ROS.