Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

2020

Learning to Play Precision Ball Sports from scratch: a Deep Reinforcement Learning Approach

Authors
Antao, L; Sousa, A; Reis, LP; Gonçalves, G;

Publication
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN)

Abstract
Over the last years, robotics has increased its interest in learning human-like behaviors and activities. One of the most common actions searched, as well as one of the most fun to replicate, is the ability to play sports. This has been made possible with the steady increase of automated learning, encouraged by the tremendous developments in computational power and improved reinforcement learning (RL) algorithms. This paper implements a beginner Robot player for precision ball sports like boccia and bocce. A new simulated environment (PrecisionBall) is created, and a seven degree-of-freedom (DoF) robotic arm, is able to learn from scratch how to win the game and throw different types of balls towards the goal (the jack), using deep reinforcement learning. The environment is compliant with OpenAI Gym, using the MuJoCo realistic physics engine for a realistic simulation. A brief comparison of the convergence of different RL algorithms is performed. Several ball weights and various types of materials correspondent to bocce and boccia are tested, as well as different friction coefficients. Results show that the robot achieves a maximum success rate of 92.7% and mean of 75.7% for the best case. While learning to play these sports with the DDPG+HER algorithm, the robotic agent acquired some relevant skills that allowed it to win.

2020

Modeling the orbital motion of Sgr A*'s near-infrared flares

Authors
Baubock, M; Dexter, J; Abuter, R; Amorim, A; Berger, JP; Bonnet, H; Brandner, W; Clenet, Y; du Foresto, VC; de Zeeuw, PT; Duvert, G; Eckart, A; Eisenhauer, F; Schreiber, NMF; Gao, F; Garcia, P; Gendron, E; Genzel, R; Gerhard, O; Gillessen, S; Habibi, M; Haubois, X; Henning, T; Hippler, S; Horrobin, M; Jimenez Rosales, A; Jocou, L; Kervella, P; Lacour, S; Lapeyrere, V; Le Bouquin, JB; Lena, P; Ott, T; Paumard, T; Perraut, K; Perrin, G; Pfuhl, O; Rabien, S; Coira, GR; Rousset, G; Scheithauer, S; Stadler, J; Sternberg, A; Straub, O; Straubmeier, C; Sturm, E; Tacconi, LJ; Vincent, F; von Fellenberg, S; Waisberg, I; Widmann, F; Wieprecht, E; Wiezorrek, E; Woillez, J; Yazici, S;

Publication
ASTRONOMY & ASTROPHYSICS

Abstract
Infrared observations of Sgr A* probe the region close to the event horizon of the black hole at the Galactic center. These observations can constrain the properties of low-luminosity accretion as well as that of the black hole itself. The GRAVITY instrument at the ESO VLTI has recently detected continuous circular relativistic motion during infrared flares which has been interpreted as orbital motion near the event horizon. Here we analyze the astrometric data from these flares, taking into account the effects of out-of-plane motion and orbital shear of material near the event horizon of the black hole. We have developed a new code to predict astrometric motion and flux variability from compact emission regions following particle orbits. Our code combines semi-analytic calculations of timelike geodesics that allow for out-of-plane or elliptical motions with ray tracing of photon trajectories to compute time-dependent images and light curves. We apply our code to the three flares observed with GRAVITY in 2018. We show that all flares are consistent with a hotspot orbiting at R similar to 9 gravitational radii with an inclination of i similar to 140 degrees. The emitting region must be compact and less than similar to 5 gravitational radii in diameter. We place a further limit on the out-of-plane motion during the flare.

2020

An Approach for Software-Intensive Business Innovation Based on Experimentation in Non-software-Intensive Companies

Authors
Silva, K; Guerra, E; Melegati, J;

Publication
XP Workshops

Abstract
AbstractSeveral companies whose businesses are not centered on technology might fail to innovate and get advantages over their competitors. For them, meaningful innovations are not necessarily related to the usage of new technologies but the optimization of some business process. In the literature, experimentation is described as an essential aspect of the innovation process. Although software engineering studies have explored experimentation, none has focused on software-intensive innovative projects in non-software-intensive companies, which consists of a contrast between the fast-changing environment in software-intensive to rigid structures in consolidated businesses. This paper proposes an experiment-oriented process to identify and implement innovation in this kind of company, including the roles involved in such processes. It has steps to identify business bottlenecks, search for solution alternatives, implement a fast and functional software proof of concept, create a plan for evolution, and migrate to a regular project to continue that idea. This paper also presents an evaluation of this process in a company focused on outsourced services, such as cleaning and maintenance. As a result, several internal procedures in a year were improved and received software support.

2020

Contribution of Social Tagging to Clustering Effectiveness Using as Interpretant the User's Community

Authors
Cunha, E; Figueira, A;

Publication
TRENDS AND INNOVATIONS IN INFORMATION SYSTEMS AND TECHNOLOGIES, VOL 1

Abstract
In this article we discuss how social tagging can be used to improve the methodology used for clustering evaluation. We analyze the impact of the integration of tags in the clustering process and its effectiveness. Following the semiotic theory, the own nature of tags allows the reflection of which ones should be considered depending on the interpretant (community of users, or tag writer). Using a case with the community of users as the interpretant, our novel clustering algorithm (k-C), which is based on community detection on a network of tags, was compared with the standard k-means algorithm. The results indicate that the k-C algorithm created more effective clusters.

2020

SnapKi-An Inertial Easy-to-Adapt Wearable Textile Device for Movement Quantification of Neurological Patients

Authors
Oliveira, A; Dias, D; Lopes, EM; Vilas Boas, MD; Cunha, JPS;

Publication
SENSORS

Abstract
The development of wearable health systems has been the focus of many researchers who aim to find solutions in healthcare. Additionally, the large potential of textiles to integrate electronics, together with the comfort and usability they provide, has contributed to the development of smart garments in this area. In the field of neurological disorders with motor impairment, clinicians look for wearable devices that may provide quantification of movement symptoms. Neurological disorders affect different motion abilities thus requiring different needs in movement quantification. With this background we designed and developed an inertial textile-embedded wearable device that is adaptable to different movement-disorders quantification requirements. This adaptative device is composed of a low-power 9-axis inertial unit, a customised textile band and a web and Android cross application used for data collection, debug and calibration. The textile band comprises a snap buttons system that allows the attachment of the inertial unit, as well as its connection with the analog sensors through conductive textile. The resulting system is easily adaptable for quantification of multiple motor symptoms in different parts of the body, such as rigidity, tremor and bradykinesia assessments, gait analysis, among others. In our project, the system was applied for a specific use-case of wrist rigidity quantification during Deep Brain Stimulation surgeries, showing its high versatility and receiving very positive feedback from patients and doctors.

2020

Skeptic: Automatic, Justified and Privacy-Preserving Password Composition Policy Selection

Authors
Johnson, SA; Ferreira, JF; Mendes, A; Cordry, J;

Publication
AsiaCCS

Abstract
The choice of password composition policy to enforce on a password-protected system represents a critical security decision, and has been shown to significantly affect the vulnerability of user-chosen passwords to guessing attacks. In practice, however, this choice is not usually rigorous or justifiable, with a tendency for system administrators to choose password composition policies based on intuition alone. In this work, we propose a novel methodology that draws on password probability distributions constructed from large sets of real-world password data which have been filtered according to various password composition policies. Password probabilities are then redistributed to simulate different user password reselection behaviours in order to automatically determine the password composition policy that will induce the distribution of user-chosen passwords with the greatest uniformity, a metric which we show to be a useful proxy to measure overall resistance to password guessing attacks. Further, we show that by fitting power-law equations to the password probability distributions we generate, we can justify our choice of password composition policy without any direct access to user password data. Finally, we present Skeptic - -a software toolkit that implements this methodology, including a DSL to enable system administrators with no background in password security to compare and rank password composition policies without resorting to expensive and time-consuming user studies. Drawing on 205,176,321 passwords across 3 datasets, we lend validity to our approach by demonstrating that the results we obtain align closely with findings from a previous empirical study into password composition policy effectiveness.

  • 1640
  • 4536