Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2011;11(10):9573-88.
doi: 10.3390/s111009573. Epub 2011 Oct 11.

Facial expression recognition based on local binary patterns and kernel discriminant isomap

Xiaoming Zhao  1 , Shiqing Zhang
Affiliations

Facial expression recognition based on local binary patterns and kernel discriminant isomap

Xiaoming Zhao et al. Sensors (Basel). 2011.

Abstract

Facial expression recognition is an interesting and challenging subject. Considering the nonlinear manifold structure of facial images, a new kernel-based manifold learning method, called kernel discriminant isometric mapping (KDIsomap), is proposed. KDIsomap aims to nonlinearly extract the discriminant information by maximizing the interclass scatter while minimizing the intraclass scatter in a reproducing kernel Hilbert space. KDIsomap is used to perform nonlinear dimensionality reduction on the extracted local binary patterns (LBP) facial features, and produce low-dimensional discrimimant embedded data representations with striking performance improvement on facial expression recognition tasks. The nearest neighbor classifier with the Euclidean metric is used for facial expression classification. Facial expression recognition experiments are performed on two popular facial expression databases, i.e., the JAFFE database and the Cohn-Kanade database. Experimental results indicate that KDIsomap obtains the best accuracy of 81.59% on the JAFFE database, and 94.88% on the Cohn-Kanade database. KDIsomap outperforms the other used methods such as principal component analysis (PCA), linear discriminant analysis (LDA), kernel principal component analysis (KPCA), kernel linear discriminant analysis (KLDA) as well as kernel isometric mapping (KIsomap).

Keywords: dimensionality reduction; facial expression recognition; isometric mapping; kernel; local binary patterns.

PubMed Disclaimer

Figures

Figure 1.
Figure 1.
An example of basic LBP operator.
Figure 2.
Figure 2.
An example of the extended LBP with different (P, R).
Figure 3.
Figure 3.
Examples of facial expression images from the JAFFE database.
Figure 4.
Figure 4.
Examples of facial expression images from the Cohn-Kanade database.
Figure 5.
Figure 5.
(a) Two eyes location of an original image from the Cohn-Kanade database. (b) The final cropped image of 110 × 150 pixels.
Figure 6.
Figure 6.
The basic system structure for facial expression recognition experiments using dimensionality reduction methods.
Figure 7.
Figure 7.
Performance comparisons of different methods on the JAFFE database.
Figure 8.
Figure 8.
Performance comparisons of different methods on the Cohn-Kanade database.
See this image and copyright information in PMC

References

    1. Cowie R, Douglas-Cowie E, Tsapatsoulis N, Votsis G, Kollias S, Fellenz W, Taylor JG. Emotion recognition in human-computer interaction. IEEE Signal Proc. Mag. 2001;18:32–80.
    1. Tian Y, Kanade T, Cohn J. Handbook of Face Recognition. Springer; Berlin, Germany: 2005. Facial expression analysis; pp. 247–275.
    1. Viola P, Jones M. Robust real-time face detection. Int. J. Comput. Vis. 2004;57:137–154.
    1. Turk MA, Pentland AP. Face recognition using eigenfaces. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR); Maui, HI, USA. 3–6 June 1991; pp. 586–591.
    1. Belhumeur PN, Hespanha JP, Kriegman DJ. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 1997;19:711–720.

Publication types

LinkOut - more resources