Research Topics

Our research objective is to develop a system to automatically recognize human identity using observed facial motion. We propose the simultaneous facial action tracking and identity/expression recognition given natural head motion. The proposed framework must be efficient and robust with respect to head motion given that (1) the dynamic models must directly relate the facial actions to the universal expressions, (2) the learning stage does not has to deal with facial images but only concerns the estimation of auto-regressive models from sequences of facial actions, which is carried out using closed-from solutions, and (3) facial actions must be related to a deformable 3D model and not to entities measured in the image plane.

Research Topics List

Facial Featuries Extraction and Geome...
Facial Featuries Extraction and Geome...

The process of registering each video sequence both spatially and temporally is a prerequisite for studying facial dynamics across individuals. In this task we aims to extract a relevant facial representation from raw images acquired by standard video cameras, namely face geometry information. To accomplish this task three main research topics will be addressed: 

1- Face geometry modeling using Active Appearance Models (AAM);

2- Improve AAM fitting w.r.t. to occlusion and light variability;

3- Accurate 3D facial reconstruction from multiple views using the AAM;

4- Quasi-dense 3D facial reconstruction.


Multi-View Facial Data Collection
Multi-View Facial Data Collection

This task is devoted to facial data collection of several individuals each performing several facial expressions and a short passage of speech. To accomplish the task, three main sub-task will be carried on:

1- Facial Expression Acquisition Platform

2- 4D facial dynamics data acquisition

3- Public release of the database


3D Facial Data Representation
3D Facial Data Representation

In this third task, high level significant information about a unique facial motion signature is extracted form the Facial Dynamics Database provided by task 2.


Classification and Performance Evalua...
Classification and Performance Evalua...

In this task we want to investigate the usefulness of several classification approaches with the single purpose of recognize the identity of individual just by analyzing the temporal dynamics of faces in 3D when expressions or speech are performed by the individual.



DEMOS

Demonstration videos