Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por CTM

2023

Modeling and Realistic Simulation of a Dexterous Robotic Hand: SVH Hand use-case

Autores
Ribeiro, FM; Correia, T; Lima, J; Goncalves, G; Pinto, VH;

Publicação
2023 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
Recent developments in dexterous robotic manipulation technologies allowed for the design of very compact, yet capable, multi-fingered robotic hands. These can be designed to emulate the human touch and feel, reducing the aforementioned need for human expertise in highly detailed tasks. The presented work focused on the application of two simulation platforms Gazebo and MuJoCo - to a use-case of a Schunk Five Finger Robotic Hand, coupled to the UR5 collaborative manipulator. This allowed to assess the relative appropriateness of each of these platforms.

2023

Deep Convolutional Neural Networks applied to Hand Keypoints Estimation

Autores
Santos, BM; Pais, P; Ribeiro, FM; Lima, J; Gonçalves, G; Pinto, VH;

Publicação
2023 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
Accurate estimation of hand shape and position is an important task in various applications, such as human-computer interaction, human-robot interaction, and virtual and augmented reality. In this paper, it is proposed a method to estimate the hand keypoints from single and colored images utilizing the pre-trained deep convolutional neural networks VGG-16 and VGG-19. The method is evaluated on the FreiHAND dataset, and the performance of the two neural networks is compared. The best results were achieved by the VGG-19, with average estimation errors of 7.40 pixels and 11.36 millimeters for the best cases of two-dimensional and three-dimensional hand keypoints estimation, respectively.

2023

FLOOR - Forklift Laser OmnidirectiOnal Robot

Autores
Pinto, VH; Ribeiro, FM; Brito, T; Pereira, AI; Lima, J; Costa, P;

Publicação
2023 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
The robot presented in this paper was developed with the main focus on participating in robotic competitions. Therefore, the subsystems here presented were developed taking into account performance criteria instead of simplicity. Nonetheless, this paper also presents background knowledge in some basic concepts regarding robot localization, navigation, color identification and control, all of which are key for a more competitive robot.

2023

Data Fusion Using Ultra Wideband Time-of-Flight Positioning for Mobile Robot Applications

Autores
Lima, J; Pinto, AF; Ribeiro, F; Pinto, M; Pereira, AI; Pinto, VH; Costa, P;

Publicação
2023 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
Self-localization of a robot is one of the most important requirements in mobile robotics. There are several approaches to providing localization data. The Ultra Wide Band Time of Flight provides position information but lacks the angle. Odometry data can be combined by using a data fusion algorithm. This paper addresses the application of data fusion algorithms based on odometry and Ultra Wide Band Time of Flight positioning using a Kalman filter that allows performing the data fusion task which outputs the position and orientation of the robot. The proposed solution, validated in a real developed platform can be applied in service and industrial robots.

2023

In-Context Impersonation Reveals Large Language Models' Strengths and Biases

Autores
Salewski, L; Alaniz, S; Rio-Torto, I; Schulz, E; Akata, Z;

Publicação
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023)

Abstract
In everyday conversations, humans can take on different roles and adapt their vocabulary to their chosen roles. We explore whether LLMs can take on, that is impersonate, different roles when they generate text in-context. We ask LLMs to assume different personas before solving vision and language tasks. We do this by prefixing the prompt with a persona that is associated either with a social identity or domain expertise. In a multi-armed bandit task, we find that LLMs pretending to be children of different ages recover human-like developmental stages of exploration. In a language-based reasoning task, we find that LLMs impersonating domain experts perform better than LLMs impersonating non-domain experts. Finally, we test whether LLMs' impersonations are complementary to visual information when describing different categories. We find that impersonation can improve performance: an LLM prompted to be a bird expert describes birds better than one prompted to be a car expert. However, impersonation can also uncover LLMs' biases: an LLM prompted to be a man describes cars better than one prompted to be a woman. These findings demonstrate that LLMs are capable of taking on diverse roles and that this in-context impersonation can be used to uncover their strengths and hidden biases. Our code is available at https://github.com/ExplainableML/in-context-impersonation.

2023

Finally, let’s use all the modes - A stable DM fitting avoiding modal truncation

Autores
Obereder A.; Bertram T.; Correia C.; Feldt M.; Raffetseder S.; Shatokhina J.; Steuer H.;

Publicação
7th Adaptive Optics for Extremely Large Telescopes Conference, AO4ELT7 2023

Abstract
METIS SCAO uses a wavefront control concept that deploys a 2-stage spatial reconstruction where the wavefront is first reconstructed on an intermediate space we call the virtual DM, and then projected onto the actual control space. This document addresses the projection of the wavefront estimation on the virtual deformable mirror (VDM) onto the control modes developed for METIS (Mid-infrared ELT Imager and Spectrograph). We present a new approach to project onto the control modes using an intermediate regularized projection on the M4 mirror and then convert to modes. This method enables us to utilise all modes for the projection and control in a stable manner, achieving high Strehl ratios for a wide range of conditions without the need for complex parameter tuning.

  • 85
  • 402