Multi-class discriminant function based on canonical correlation in high dimension low sample size
dc.contributor.author | Tamatani, M. | en |
dc.contributor.author | Naito, K. | en |
dc.contributor.author | Koch, I. | en |
dc.date.issued | 2013 | en |
dc.description.abstract | In multi-class discriminant analysis for High Dimension Low Sample Size settings it is not possible to dene Fisher's discriminant function, since the sample covariance matrix is singular. For the special case of two-class problems, the naive Bayes rule has been studied, and combined with feature selection, this approach yields good practical results. We show how to extend the naive Bayes rule based on the naive canonical correlation matrix to a general setting for K≥2 classes, and we propose variable ranking and feature selection methods which integrate information from all K-1 eigenvectors. Provided the dimension does not grow too fast, we show that the K-1 sample eigenvectors are consistent estimators of the corresponding population parameters as both the dimension and sample size grow, and we give upper bounds for the misclassification rate. For real and simulated data we illustrate the performance of the new method which results in lower errors and typically smaller numbers of selected variables than existing methods. | en |
dc.description.statementofresponsibility | Mitsuru Tamatani, Kanta Naito and Inge Koch | en |
dc.identifier.citation | Bulletin of Informatics and Cybernetics, 2013; 45:67-101 | en |
dc.identifier.issn | 0286-522X | en |
dc.identifier.uri | http://hdl.handle.net/2440/109539 | |
dc.language.iso | en | en |
dc.publisher | Research Association of Statistical Sciences | en |
dc.rights | Copyright Status Unknown | en |
dc.source.uri | https://www.lib.kyushu-u.ac.jp/en/publications_kyushu/bic | en |
dc.subject | High dimension low sample size; canonical correlations; consistency; naive Bayes rule; misclassification; multi-class linear discriminant analysis | en |
dc.title | Multi-class discriminant function based on canonical correlation in high dimension low sample size | en |
dc.type | Journal article | en |
pubs.publication-status | Published | en |