Research

Semantic Media Retrieval

Semantic Media Retrieval is about the search of knowledge from multimedia data sources. In our research group we focus the attention to images and videos.

People describe their life experience using words, that is a representation that could have many differences, when we consider different persons, due to the users’ knowledge and experience and because of the context. This represent a “semantic gap” between the conceptualizations of the world expressed using language, and the experience of the world, whose most direct representations are photos and media in general. Due to this, current media understanding systems are still very much example-driven (e.g., find photos similar to a given one on the basis of a set of features).

Main activities:

  • Content and Context Based Indexing
  • Event Based Image and Video Understanding
  • Gamification of Media Retrieval
  • Social Media

>> more

Multimedia Forensics

The pervasive availability of the Internet, allied with the spread of increasingly powerful digital facilities, has led digital multimedia to be the primary source of visual information in many aspect of our society, including media, politics, national security and advertisement. However, the historical assumption that photographs can be trusted as a true representation of reality does not hold anymore. Nowadays, affordable and sophisticated graphics editing software allow for the creation of sophisticated and visually compelling photographic fakes, which easily puzzle our perception of reality. Trustworthiness of the information conveyed by digital media is becoming one of the key challenges for our information society, strongly affecting the success and penetration of future multimedia applications. The urgent need of efficient techniques to cope with security issues related with multimedia data motivates the MMLab research. Multimedia forensics techniques are particularly relevant as they deal with the recovery of information that can be directly used to authenticate and estimate the trustworthiness of digital multimedia contents.

Main activities:

  • Digital Tampering
  • Digital Source Identification
  • Computer Generated vs Natural Imagery
  • Digital Counter-forensics
  • Digital Watermarking

>> more

Computer Vision and Behavior Analysis

Main activities:

  • Visual Tracking
  • Smart Camera Positioning
  • Crowd Analysis
  • Atomic Actions Recognition
  • Social Interactions Analysis

>> more