2024
Authors
Bonci, EA; Kaidar Person, O; Antunes, M; Ciani, O; Cruz, H; Di Micco, R; Gentilini, OD; Heil, J; Kabata, P; Romariz, M; Gonçalves, T; Martins, H; Borsoi, L; Mika, M; Pfob, A; Romem, N; Schinkoethe, T; Silva, G; Bobowicz, M; Cardoso, MJ;
Publication
JOURNAL OF CLINICAL ONCOLOGY
Abstract
2024
Authors
A. Pfob; E-A. Bonci; O. Kaidar-Person; M. Antunes; O. Ciani; H. Cruz; R. Di Micco; O.D. Gentilini; J. Heil; P. Kabata; M. Romariz; T. Gonçalves; H.G. Martins; L. Borsoi; M. Mika; N. Romem; T. Schinköthe; G. Silva; M. Bobowicz; M.J. Cardoso;
Publication
ESMO Open
Abstract
2024
Authors
Eduard-Alexandru Bonci; Orit Kaidar-Person; Marilia Antunes; Oriana Ciani; Helena Cruz; Rosa Di Micco; Oreste Gentilini; Pedro Gouveia; Jörg Heil; Pawel Kabata; Nuno Freitas; Tiago Gonçalves; Miguel Romariz; Henrique Martins; Carlos Mavioso; Martin Mika; André Pfob; Timo Schinköthe; Giovani Silva; Maria-João Cardoso;
Publication
European Journal of Surgical Oncology
Abstract
2024
Authors
Bonel, EA; Kaidar-Person, O; Antunes, M; Ciani, O; Cruz, H; Di Micco, R; Gentilini, O; Heil, J; Kabata, P; Romariz, M; Gonçalves, T; Martins, H; Borsoi, L; Mika, M; Pfob, A; Romem, N; Schinköthe, T; Silva, G; Senkus, E; Cardoso, MJ;
Publication
ANNALS OF SURGICAL ONCOLOGY
Abstract
2024
Authors
Correia, T; Ribeiro, FM; Pinto, VH;
Publication
OPTIMIZATION, LEARNING ALGORITHMS AND APPLICATIONS, PT II, OL2A 2023
Abstract
The notable expansion of technologies related to automated processes has been observed in recent years, largely driven by the significant advantages they provide across diverse industries. Concurrently, there has been a rise in simulation technologies aimed at replicating these complex systems. Nevertheless, in order to fully leverage the potential of these technologies, it is crucial to ensure the highest possible resemblance of simulations to real-world scenarios. In brief, this work consists of the development of a data acquisition and processing pipeline allowing a posterior search for the optimal physical parameters in MuJoCo simulator to obtain a more accurate simulation of a dexterous robotic hand. In the end, a Random Search optimization algorithm was used to validate this same pipeline.
2024
Authors
Dani, M; Rio Torto, I; Alaniz, S; Akata, Z;
Publication
PATTERN RECOGNITION, DAGM GCPR 2023
Abstract
Post-hoc explanation methods have often been criticised for abstracting away the decision-making process of deep neural networks. In this work, we would like to provide natural language descriptions for what different layers of a vision backbone have learned. Our DeViL method generates textual descriptions of visual features at different layers of the network as well as highlights the attribution locations of learned concepts. We train a transformer network to translate individual image features of any vision layer into a prompt that a separate off-the-shelf language model decodes into natural language. By employing dropout both per-layer and per-spatial-location, our model can generalize training on image-text pairs to generate localized explanations. As it uses a pre-trained language model, our approach is fast to train and can be applied to any vision backbone. Moreover, DeViL can create open-vocabulary attribution maps corresponding to words or phrases even outside the training scope of the vision model. We demonstrate that DeViL generates textual descriptions relevant to the image content on CC3M, surpassing previous lightweight captioning models and attribution maps, uncovering the learned concepts of the vision backbone. Further, we analyze fine-grained descriptions of layers as well as specific spatial locations and show that DeViL outperforms the current state-of-the-art on the neuron-wise descriptions of the MILANNOTATIONS dataset.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.