Change search
ReferencesLink to record
Permanent link

Direct link
Evolved decision trees as conformal predictors
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.
2013 (English)In: 2013 IEEE Congress on Evolutionary Computation (CEC), IEEE Computer Society, 2013, 1794-1801 p.Conference paper (Refereed)
Abstract [en]

In conformal prediction, predictive models output sets of predictions with a bound on the error rate. In classification, this translates to that the probability of excluding the correct class is lower than a predefined significance level, in the long run. Since the error rate is guaranteed, the most important criterion for conformal predictors is efficiency. Efficient conformal predictors minimize the number of elements in the output prediction sets, thus producing more informative predictions. This paper presents one of the first comprehensive studies where evolutionary algorithms are used to build conformal predictors. More specifically, decision trees evolved using genetic programming are evaluated as conformal predictors. In the experiments, the evolved trees are compared to decision trees induced using standard machine learning techniques on 33 publicly available benchmark data sets, with regard to predictive performance and efficiency. The results show that the evolved trees are generally more accurate, and the corresponding conformal predictors more efficient, than their induced counterparts. One important result is that the probability estimates of decision trees when used as conformal predictors should be smoothed, here using the Laplace correction. Finally, using the more discriminating Brier score instead of accuracy as the optimization criterion produced the most efficient conformal predictions.

Place, publisher, year, edition, pages
IEEE Computer Society, 2013. 1794-1801 p.
National Category
Information Systems
Research subject
Computer and Systems Sciences
URN: urn:nbn:se:su:diva-97216DOI: 10.1109/CEC.2013.6557778ISBN: 978-1-4799-0453-2OAI: diva2:676260
2013 IEEE Congress on Evolutionary Computation June 20-23, Cancún, México
Available from: 2013-12-05 Created: 2013-12-05 Last updated: 2014-01-24Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Boström, Henrik
By organisation
Department of Computer and Systems Sciences
Information Systems

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 12 hits
ReferencesLink to record
Permanent link

Direct link