Separable linear discriminant analysis

Jianhua ZHAO, Leung Ho Philip YU, Lei SHI, Shulan LI

Research output: Contribution to journalArticlespeer-review

9 Citations (Scopus)

Abstract

Linear discriminant analysis (LDA) is a popular technique for supervised dimension reduction. Due to the curse of dimensionality usually suffered by LDA when applied to 2D data, several two-dimensional LDA (2DLDA) methods have been proposed in recent years. Among which, the Y2DLDA method, introduced by Ye et al. (2005), is an important development. The idea is to utilize the underlying 2D data structure to seek for an optimal bilinear transformation. However, it is found that the proposed algorithm does not guarantee convergence. In this paper, we show that the utilization of a bilinear transformation for 2D data is equivalent to modeling the covariance matrix of 2D data as separable covariance matrix. Based on this result, we propose a novel 2DLDA method called separable LDA (SLDA). The main contributions of SLDA include (1) it provides interesting theoretical relationships between LDA and some 2DLDA methods; (2) SLDA provides a building block for mixture extension; (3) unlike Y2DLDA, a neatly analytical solution can be obtained as that in LDA. Empirical results show that our proposed SLDA achieves better recognition performance than Y2DLDA while being computationally much more efficient. Copyright © 2012 Elsevier B.V. All rights reserved.
Original languageEnglish
Pages (from-to)4290-4300
JournalComputational Statistics and Data Analysis
Volume56
Issue number12
Early online dateApr 2012
DOIs
Publication statusPublished - Dec 2012

Citation

Zhao, J., Yu, P. L. H., Shi, L., & Li, S. (2012). Separable linear discriminant analysis. Computational Statistics and Data Analysis, 56(12), 4290-4300. doi: 10.1016/j.csda.2012.04.003

Keywords

  • Linear discriminant analysis
  • Separable
  • Two-dimensional data
  • Face recognition

Fingerprint Dive into the research topics of 'Separable linear discriminant analysis'. Together they form a unique fingerprint.