Loading...

Towards MPEG4 compatible face representation via hierarchical clustering-based facial feature extraction

Ghahari, A ; Sharif University of Technology

970 Viewed
  1. Type of Document: Article
  2. DOI: 10.1109/ISCI.2011.5958955
  3. Abstract:
  4. Multi-view imaging and display systems has taken a divide and conquer approach to 3D sensing and visualization. We aim to make more reliable and robust automatic feature extraction and natural 3D feature construction from 2D features detected on a pair of frontal and profile view face images. We propose several heuristic algorithms to minimize possible errors introduced by prevalent imperfect orthogonal condition and non-coherent luminance trying to address the problems incurred with illumination discrepancies on common surface points in accommodation of multi-views. In our approach, we first extract the 2D features that are visible to both cameras in both views. Then, we estimate the coordinates of the features in the hidden profile view based on the visible features extracted in the two orthogonal views. After that, based on the coordinates of the extracted features, we deform a 3D generic model to perform the desired deformation based modeling. Finally, the face model is texture-mapped by projecting the input 2D images onto the vertices of the face model. As the reconstructed 3D face model is MPEG4 compliant, it can be readily animated by standard MPEG4 facial animation parameters (FAPs). Present study proves the scope of modeling procedure for real-time applications such as face recognition and performance driven facial animation
  5. Keywords:
  6. 2D features ; 3D sensing ; MPEG4 compliant ; Multi-view imaging ; 2D images ; 3-D sensing ; 3D face models ; Automatic feature extraction ; Display system ; Divide-and-conquer approach ; Face images ; Face models ; Face representations ; Facial feature extraction ; Feature construction ; Generic models ; Modeling procedure ; Mpeg-4 facial animation parameters ; Multi-views ; Non-coherent ; Orthogonal condition ; Orthogonal views ; Performance-driven facial animation ; Real-time application ; Surface points ; View-based ; Animation ; Deformation ; Display devices ; Face recognition ; Feature extraction ; Heuristic algorithms ; Hierarchical systems ; Information science ; Speech recognition ; Visualization ; Three dimensional
  7. Source: ISCI 2011 - 2011 IEEE Symposium on Computers and Informatics ; 2011 , Pages 436-441 ; 9781612846903 (ISBN)
  8. URL: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?reload=true&arnumber=5958955