Department of Mathematics
Sparse orthogonal linear discriminant analysis
In this paper, sparse orthogonal linear discriminant analysis (OLDA) is studied. The main contributions of the present work include the following: (i) all minimum Frobeniusnorm/dimension solutions of the optimization problem used for establishing OLDA are characterized explicitly; and (ii) this explicit characterization leads to two numerical algorithms for computing a sparse linear transformation for OLDA. The first is based on the gradient flow approach while the second is a sequential linear Bregman method. We experiment with real world datasets to illustrate that the sequential linear Bregman method is much better than the gradient flow approach. The sequential linear Bregman method always achieves comparable classification accuracy with the normal OLDA, satisfactory sparsity and orthogonality, and acceptable CPU times. © 2012 Society for Industrial and Applied Mathematics.
Dimensionality reduction, Linear discriminant analysis, Sparsity
Source Publication Title
SIAM Journal on Scientific Computing
Society for Industrial and Applied Mathematics
Link to Publisher's Edition
Chut, Delin, Li-Zhi Liao, and Michael K. Ng. "Sparse orthogonal linear discriminant analysis." SIAM Journal on Scientific Computing 34.5 (2012): A2421-A2443.