Effect of Data Discretization on the Classification Accuracy in a High-Dimensional Framework
2012 (English)In: International Journal of Intelligent Systems, ISSN 0884-8173, E-ISSN 1098-111X, Vol. 27, no 4, 355-374 p.Article in journal (Refereed) Published
We investigate discretization of continuous variables for classification problems in a high-dimensional framework. As the goal of classification is to correctly predict a class membership of an observation, we suggest a discretization method that optimizes the discretization procedure using the misclassification probability as a measure of the classification accuracy. Our method is compared to several other discretization methods as well as result for continuous data. To compare performance we consider three supervised classification methods, and to capture the effect of high dimensionality we investigate a number of feature variables for a fixed number of observations. Since discretization is a data transformation procedure, we also investigate how the dependence structure is affected by this. Our method performs well, and lower misclassification can be obtained in a high-dimensional framework for both simulated and real data if the continuous feature variables are first discretized. The dependence structure is well maintained for some discretization methods.
Place, publisher, year, edition, pages
2012. Vol. 27, no 4, 355-374 p.
Probability Theory and Statistics
Research subject Statistics
IdentifiersURN: urn:nbn:se:su:diva-76111DOI: 10.1002/int.21527ISI: 000301654000004OAI: oai:DiVA.org:su-76111DiVA: diva2:526208