Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Facts & Numbers
000
Presentation

Telecommunications and Multimedia

At CTM, our vision is to promote a lively and sustainable world where networked intelligence enables ubiquitous interaction with sensory-rich content. Our mission is to develop advanced systems and technologies to enable high capacity, efficient, and secure communications, media knowledge extraction, and immersive ubiquitous multimedia applications.

We work in 4 main areas of research: Optical and Electronic Technologies, Wireless Networks, Multimedia and Communications Technologies, and VCMI (Visual Computing and Machine Intelligence).

Latest News
Networked Intelligent Systems

INESC TEC and ISEP research innovates access to cinema archives

The research carried out within the scope of the CHIC project aims to make an important source of information, with cultural and historical value, accessible to the public and society in general. By proposing a set of tools that allow intuitive access to cinema archives, the developed solution focuses on transforming the current scenario, according to which said archives are content deposits only available to specialised technical staff.  

28th April 2021

INESC TEC teams qualified in the first stage of an international computer vision competition

A gamified goniometer for posture clinical assessment and a technology for locating robots considering tree trunks as a visual reference are the two INESC TEC's solutions selected for the second phase of OpenCV AI Competition 2020, the largest global competition in AI and computer vision

17th March 2021

Networked Intelligent Systems

INESC TEC project allows reducing costs in professional audio-visual production

The CHIC project – Cooperative Holistic View on Internet and Content, the largest national R&D project in the media sector, enables the reduction of costs associated with professional audio-visual production – as done in television studies, for instance.

11th March 2021

Networked Intelligent Systems

INESC TEC researchers awarded at the International Joint Conference on Biometrics

The conference awarded researchers Ana Rebelo and Filipa Sequeira for their work on reviewing papers.

13th January 2021

Networked Intelligent Systems

INESC TEC concluded the largest R&D project in the Portuguese media sector

The CHIC project – Cooperative Holistic View on Internet and Content, the largest national R&D project in the media sector, ended on December 31, 2020.

12th January 2021

Interest Topics
146

Featured Projects

MATinMOL

Matter Waves in Moiré Lattices

2021-2024

DECARBONIZE

DEvelopment of strategies and policies based on energy and non-energy applications towards CARBON neutral cities via digitalization for citIZEns and society

2021-2022

5GforUtilities

5G for Utilities

2020-2021

Training4DS

Formação Avançada em Data Science - Altice Labs

2020-2020

PFAI4.0

Programa de Formação Avançada Industria 4.0

2020-2021

iiLab

Ampliação da Infraestrutura Tecnológica do INESC TEC para a Transformação Digital da Indústria

2020-2022

FLY_PT

Mobilizar a indústria aeronáutica nacional para a disrupção no transporte aéreo urbano do futuro

2020-2023

TAMI

Transparent Artificial Medical Intelligence

2020-2023

WiFi4DSO

Tecnologia Wi-Fi aplicada a cenários de um DSO

2019-2019

LeGeM

Learning Representations and Generative Models for 3D Breast Data

2019-2021

CorkNetmon

Network Infrastructure Monitoring for Remote Cork Manufacturing

2019-2020

Inphinit

Bolsa de Doutoramento ”LA CAIXA” Inphinit

2019-2022

SLID

Invitation to collaborate

2019-2021

ProLab

Consultoria profissional com recurso ao laboratório de electrónica

2019-2019

InterConnect

Interoperable Solutions Connecting Smart Homes, Buildings and Grids

2019-2023

TenisApp2

Aplicação móvel para análise de jogos de ténis - 2

2019-2021

NFCAD

Near Field Contact Antenna Development

2019-2020

EuConNeCts4

European Conferences on Networks and Communications

2019-2021

SCA

Serviço de caracterização antenas

2019-2019

RESPONDRONE

NOVEL INTEGRATED SOLUTION OF OPERATING A FLEET OF DRONES WITH MULTIPLE SYNCHRONIZED MISSIONS FOR DISASTER RESPONSES

2019-2022

STRx

Sistema de transmissão e receção de sinal de orientação eletrónica para a próxima geração de constelações de satélites (LEO e MEO).

2019-2022

InterCork

Remote Cork Manufacturing

2019-2019

CLOUD4CANDY

Cloud for CANDY

2019-2019

MetroRec

Avaliação do sistema gravação vídeo do Metro do Porto

2019-2019

Evo3DModel

Consultoria para melhoria do sistema INSIGHT

2019-2020

FollicleCounter

Prestação de serviços de investigação e desenvolvimento em matéria de processamento de imagem para maior fiabilidade de aferição dos folículos implantados

2018-2021

NB-IoT

Consultoria no âmbito da tecnolofia Narrowband-internet of Things

2018-2019

XPERIMUS

Experimentação em música na cultura portuguesa: História, contextos e práticas nos séculos XX e XXI

2018-2022

Blueenergy

Blue energy generation using hybrid triboelectric/photovoltaic systems for the long term deployment of Autonomous Underwater Vehicles

2018-2020

AUTOMOTIVE

AUTOmatic multiMOdal drowsiness detecTIon for smart Vehicles

2018-2021

GROW

Long-range broadband underwater wireless communications

2018-2021

HELP-MD

O poder emocional e curativo da música e da dança

2018-2022

NeurOxide

Integration of oxide thin film transistors and memristors in neuromorphic networks

2018-2021

PEPCC

Power efficiency and performance for embedded and HPC systems with custom CGRAs

2018-2021

LUCAS

Lung cancer screening - A non-invasive methodology for early diagnosis

2018-2022

HEMOSwimmers

Hemodynamic optimization around 3D swimming microbots

2018-2021

CLARE

Computer-aided cervical cancer screening

2018-2021

ENDURANCE

Underwater wireless energy and communications enabling long-term deep-sea presence

2018-2020

S-MODE

Screening of antibiotic contamination by mobile devices

2018-2021

UnWSNet

Underwater Wireless Sensor Networks

2018-2018

SIMBED

Fed4fire testbed for experimentation

2018-2019

FotoInMotion

Repurposing and enriching images for immersive storytelling through smart digital tools

2018-2020

ConnectedRefinery

Rede de comunicações sem fios para as instalações da Galp Energia em Leixões

2018-2019

5G

Componentes e Serviços para Redes 5G

2018-2021

Arquitetura_IoT

Consultoria sobre a arquitetura de referência para implementação serviços de informação baseados em IoT

2017-2018

CompMash

Music compatibility models for interactive mashup applications

2017-2019

CHIC

Cooperative Holistic view on Internet and Content

2017-2020

UGREEN

Otimização do Consumo Energético de Redes LTE-U e Wi-Fi em Cenários de Coexistência

2017-2019

SURGEONMATE

Video processing for surgery analysis

2017-2017

TERAPOD

Terahertz based Ultra High Bandwidth Wireless Access Networks

2017-2021

TEC4Sea

Modular Platform for Research, Test and Validation of Technologies supporting a Sustainable Blue Economy

2017-2021

ROMOVI

ROMOVI: Robô Modular e cooperativo para Vinhas de encosta

2017-2019

BCCT.Plan

BCCT.plan: Ferramenta 3D para o planeamento do tratamento conservador do cancro da mama

2016-2020

WI-GREEN

WI-GREEN .: Otimização do consumo energético de redes Wi-Fi sensível aos padrões de tráfego

2016-2018

RAWFIE

Road-, Air- and Water-based Future Internet Experimentation

2016-2019

Cloud-Setup

PLATAFORMA DE PREPARAÇÃO DE CONTEÚDOS AUDIOVISUAIS PARA INGEST NA CLOUD

2016-2019

EVOXANT

Bacterial evolution beyond the cultured isolates - Xanthomonas arboricola pv. juglandis as a paradigm

2016-2020

WISE

TrafficAware Flying Backhaul Mesh Networks

2016-2019

MareCom

Redes e serviços marítimos comunitários

2016-2018

CORAL-TOOLS

CORAL – Sustainable Ocean Exploitation: Tools and Sensors

2016-2018

STRONGMAR-CRAS

STRengthening MARritime Technology Research Center

2016-2018

BLUECOM+

Connecting Humans and Systems at Remote Ocean Areas using Cost-effective Broadband Communications

2015-2017

ENDURE

Enabling Long-Term Deployments of Underwater Robotic Platforms in Remote Oceanic Locations

2015-2017

FOUREYES

TEC4Growth - RL FourEyes - Intelligence, Interaction, Immersion and Innovation for media industries

2015-2019

NanoStima-RL5

NanoSTIMA - Advanced Methodologies for Computer-Aided Detection and Diagnosis

2015-2019

NanoStima-RL1

NanoSTIMA - Macro-to-Nano Human Sensing Technologies

2015-2019

SMILES

SMILES - Smart, Mobile, Intelligent and Large scale Sensing and analytics

2015-2019

VAMOS

Viable Alternative Mine Operating System

2015-2019

SCREEN

Space Cognitive Radio for Electromagnetic Environment maNagement

2015-2016

iBROW

Innovative ultra-BROadband ubiquitous Wireless communications through terahertz transceivers

2015-2018

AnyPLACE

Adaptable Platform for Active Services Exchange

2015-2018

SmarterEMC2

Smarter Grid: Empowering SG Market Actors through Information and Communication Technologies

2015-2017

SEAD

Statistically Enhanced Mixed-Signaland Analog Design

2014-2016

MDX

Simulation Models

2014-2016

Unisat

Serviços de banda-larga em simultâneo com receção de televisão por satélite

2014-2014

TWAVE

Phase conjugated twin waves to unlock the potential of future spatial division multiplexed systems (TWave)

2014-2015

HiperWireless

Microwave Point-to-Multipoint Communications in Free Hiperlan Band (17GHZ)

2014-2015

PGLobal

Desenvolvimento de software para ser integrado numa plataforma de recolha automática e selecção de conteúdos de jornais participantes de vários países

2014-2015

SUNNY

Smart UNmanned aerial vehicle sensor Network for detection of border crossing and illegal entrY

2014-2018

PCSA

Place characterisation from sensing and acting

2013-2014

SIVIC

Wearable Integrated Cardiovascular Surveillance System

2013-2015

Creation

Cognitive Radio Transceiver Design for energy Efficient Daa Transmission

2013-2016

TDT

Digital terrestrial television (DTT) signal monitoring

2013-2014

PICTURE

Patient Information Combined for the Assessment of specific surgical outcomes in breast cancer

2013-2016

Confine

Community Networks Testbed for the Future Internet

2013-2015

MAT

Media Arts and Technology

2013-2015

Sensing

Network Sensing for Critical Systems Monitoring

2013-2015

SmartGrids

Smart Grids

2013-2015

Cooperation

Cooperation and Perception for Augmented Autonomy

2013-2015

ASSIST

Retail futsal statistics

2012-2013

MOGTIDT

Station to obtain 3D images

2012-2012

MTGrid

Multi Technology Communication Infrastructure for the Smart Grid

2012-2015

RETAIL_PRO

Integrated Platform to Strategically Manage Retail Environments

2012-2015

WiSAT

Waveguide passive devices in S and Ka band

2012-2012

SARA

Asset Management System for Road Networks

2012-2015

CPT

Cartesian Polar Transmitter

2012-2014

MC-WMNs

Multiple Context-based Wireless Mesh Networks (MC-WMNs)

2012-2015

SENSEIVER

Low-cost and energy-efficient LTCC sensor/IR-UWB transceiver solutions for a sustainable healthy environment

2011-2015

MIRes

Roadmap for Music Information Research

2011-2013

AdChrono

Automatic optimisation of online advertising

2011-2013

3dBCT

3D Models for Aesthetic Evaluations and Result Predictions in Breast Cancer Procedures

2011-2014

CASA

Computational Auditory Scene Analysis Framework for Sound Segregation in Music Signals

2011-2014

SHAKEIT

Mechanisms of Musical Groove and applications

2011-2013

MultiRadioAccess

Multi-radio (HSPA and WiFi) aggregation to provide a higher rate than those of the individual networks

2011-2011

Steering

Steering of light in nonlinear waveguides with resonant interactions

2011-2014

CNG

New Generation Contents for Education and Vocational Training

2011-2014

AAL4ALL

Ambient Assisted Living for All

2011-2015

SUM

Sensing and Understanding human Motion dynamics

2011-2013

User-Tracking2.0

User-Tracking for Web traffic

2010-2011

SELF-PVP

Self-organizing power management for photovoltaic power plants

2010-2014

ImTV

On demand Immersive-TV for communities of Media Producers and Consumers

2010-2014

NeTS

Next Generation Network Operations and Management

2010-2013

EscolinhasCriativas

Creative Spaces for Creative Kids

2010-2013

Convergence

Content-centric, publish-subscribe service model for the Internet

2010-2013

SafeHomeHealthCare

Interference-free Home Health-Care Smart Spaces using Search Algorithms and Meta-Reality Reflection

2010-2013

OSP

Optical Signal Processing Using Highly Nonlinear Fibers

2010-2013

ProLimb

Electronic sensing for the prophylaxis of lower limb pathologies

2010-2013

ContextAware

Context-aware and personalized multimedia services

2010-2011

REIVE

Intelligent electric networks with plug-in electric vehicles

2010-2012

Alicante

MediA Ecosystem Deployment through Ubiquitous Content-Aware Network Environments

2010-2013

P3.net

On-line daily news platform for young people

2010-2012

LUL

Living Usability Lab for Next Generation Networks

2010-2012

Hotel3.0

Web3.0 Platform for the hospitality market

2010-2012

WOWI

Wireless-optical-wireless interfaces for picocellular access networks

2010-2013

RobVigil

Collaborative and intelligent surveillance robot for the security area

2010-2012

Daphne

Developing aircraft photonic networks

2009-2013

SWIOP

Intelligent and secure Webmail System to Support Personal Organization

2009-2011

SITMe

Metropolitan multi-technology wireless network for public transportation systems

2009-2012

Mobiles

Sustainable electric mobility - Solutions for the logistics associated with electric vehicle battery charging

2009-2012

V-SAT

Passive devices for VSAT (Very Small Aperture Terminal) applications

2009-2009

PortalDouro

Tourism portal for the Douro region

2009-2011

KINETIC

Controller driven adaptive and dynamic music composition systems

2009-2011

ASP-RedesDomesticas

Authentication, Security and Privacy (ASP) Solutions for home networks

2009-2010

MuMoMgt

Multicast and mobility management in heterogeneous access networks

2009-2012

ReCoop

Cooperative Wireless Networks

2009-2012

SemanticPACS

Picture Archiving and Communication System with Semantic Search Engine

2009-2011

Palco3.0

Intelligent Web system to support the management of a social network on music

2008-2011

AHRS

Attitude-Heading Reference System based on MEMS technology

2008-2010

GeCLIFmcast

Management of multicast sessions for IP based services created by users

2008-2009

DR-Vids

Dynamic reconfiguration of logical resources for real time foreground/background video segmentation

2007-2010

Vector

Compilation and Synthesis of Image Processing Algorithms in MATLAB for FPGA-based Custom Vector Units

2007-2011

OMR

Optical recognition system for handwritten music scores

2007-2010

BCCT

Advanced objective method for the evaluation of the aesthetic result of Breast Cancer Conservative Treatment

2007-2010

ROFWDM

Design and Optimisation of WDM Millimetre-Wave Fibre-Radio Systems

2007-2010

EDCine

Enhanced Digital Cinema

2007-2009

VISNETII

Networked Audiovisual Media Technologies

2006-2009

Team
002

Laboratories

Laboratory of Sound and Music Computing

Optical and Electronic Technologies Research Laboratory

Publications

CTM Publications

View all Publications

2021

A Systematic Survey of ML Datasets for Prime CV Research Areas—Media and Metadata

Authors
Castro, HF; Cardoso, JS; Andrade, MT;

Publication
Data

Abstract
The ever-growing capabilities of computers have enabled pursuing Computer Vision through Machine Learning (i.e., MLCV). ML tools require large amounts of information to learn from (ML datasets). These are costly to produce but have received reduced attention regarding standardization. This prevents the cooperative production and exploitation of these resources, impedes countless synergies, and hinders ML research. No global view exists of the MLCV dataset tissue. Acquiring it is fundamental to enable standardization. We provide an extensive survey of the evolution and current state of MLCV datasets (1994 to 2019) for a set of specific CV areas as well as a quantitative and qualitative analysis of the results. Data were gathered from online scientific databases (e.g., Google Scholar, CiteSeerX). We reveal the heterogeneous plethora that comprises the MLCV dataset tissue; their continuous growth in volume and complexity; the specificities of the evolution of their media and metadata components regarding a range of aspects; and that MLCV progress requires the construction of a global standardized (structuring, manipulating, and sharing) MLCV “library”. Accordingly, we formulate a novel interpretation of this dataset collective as a global tissue of synthetic cognitive visual memories and define the immediately necessary steps to advance its standardization and integration.

2021

Transparent Control Flow Transfer between CPU and Accelerators for HPC

Authors
Granhão, D; Ferreira, JC;

Publication
Electronics

Abstract
Heterogeneous platforms with FPGAs have started to be employed in the High-Performance Computing (HPC) field to improve performance and overall efficiency. These platforms allow the use of specialized hardware to accelerate software applications, but require the software to be adapted in what can be a prolonged and complex process. The main goal of this work is to describe and evaluate mechanisms that can transparently transfer the control flow between CPU and FPGA within the scope of HPC. Combining such a mechanism with transparent software profiling and accelerator configuration could lead to an automatic way of accelerating regular applications. In this work, a mechanism based on the ptrace system call is proposed, and its performance on the Intel Xeon+FPGA platform is evaluated. The feasibility of the proposed approach is demonstrated by a working prototype that performs the transparent control flow transfer of any function call to a matching hardware accelerator. This approach is more general than shared library interposition at the cost of a small time overhead in each accelerator use (about 1.3ms in the prototype implementation).

2021

Joint Traffic-Aware UAV Placement and Predictive Routing for Aerial Networks

Authors
Almeida, EN; Coelho, A; Ruela, J; Campos, R; Ricardo, M;

Publication
CoRR

Abstract

2021

MONITORIA: The start of a new era of ambulatory heart failure monitoring? Part I – Theoretical Rationale [MONITORIA: o início de uma nova era na monitoração da insuficiência cardíaca? Parte I – Fundamentação teórica]

Authors
Martins, C; Machado da Silva, J; Guimarães, D; Martins, L; Vaz da Silva, M;

Publication
Revista Portuguesa de Cardiologia

Abstract
Heart failure (HF) is a multifactorial chronic syndrome with progressive increasing incidence causing a huge financial burden worldwide. Remote monitoring should, in theory, improve HF management, but given increasing morbidity and mortality, a question remains: are we monitoring it properly? Device-based home monitoring enables objective and continuous measurement of vital variables and non-invasive devices should be first choice for elderly patients. There is no shortage of literature on the subject, however, most studies were designed to monitor a single variable or class of variables that were not properly assembled and, to the best of our knowledge, there are no large randomized studies about their impact on HF patient management. To overcome this problem, we carefully selected the most critical possible HF decompensating factors to design MONITORIA, a non-invasive device for comprehensive HF home monitoring. MONITORIA stands for MOnitoring Non-Invasively To Overcome mortality Rates of heart Insufficiency on Ambulatory, and in this paper, which is part I of a series of three articles, we discuss the theoretical basis for its design. MONITORIA and its inherent follow-up strategy will optimize HF patient care as it is a promising device, which will essentially adapt innovation not to the disease but rather to the patients. © 2020 Sociedade Portuguesa de Cardiologia

2021

Secure Triplet Loss: Achieving Cancelability and Non-Linkability in End-to-End Deep Biometrics

Authors
Pinto, JR; Correia, MV; Cardoso, JS;

Publication
IEEE Transactions on Biometrics, Behavior, and Identity Science

Abstract

Supervised Theses

2020

Fostering immersion and expressiveness in multimodal virtual environment using sonic interaction design

Author
Eduardo Miguel Campos Magalhães

Institution
UP-FEUP

2020

Open World Face Recognition

Author
Arthur Johas Matta

Institution
UP-FEUP

2020

Multiple instance learning for lung cancer characterization in computed tomography scans

Author
Julieta Pintado Jorge Frade

Institution
INESCTEC

2020

Reduction of non-regression time through Artificial Intelligence

Author
Mariana Lopes da Silva

Institution
UP-FEUP

2020

Upgrade do Simulador da Linha de Produção Flexível do Laboratório de Automação

Author
Sebastião José Fernandes de Oliveira Cunha Reis

Institution
UP-FEUP

Facts & Figures

11Proceedings in indexed conferences

2020

2R&D Employees

2020

15Academic Staff

2020

Contacts