Bridging causal relevance and pattern discriminability: mining emerging patterns from high-dimensional data
Date
2013
Authors
Yu, K.
Ding, W.
Wang, H.
Wu, X.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
IEEE Transactions on Knowledge and Data Engineering, 2013; 25(12):2721-2739
Statement of Responsibility
Conference Name
Abstract
It is a nontrivial task to build an accurate emerging pattern (EP) classifier from high-dimensional data because we inevitably face two challenges 1) how to efficiently extract a minimal set of strongly predictive EPs from an explosive number of candidate patterns, and 2) how to handle the highly sensitive choice of the minimal support threshold. To address these two challenges, we bridge causal relevance and EP discriminability (the predictive ability of emerging patterns) to facilitate EP mining and propose a new framework of mining EPs from high-dimensional data. In this framework, we study the relationships between causal relevance in a causal Bayesian network and EP discriminability in EP mining, and then reduce the pattern space of EP mining to direct causes and direct effects, or the Markov blanket (MB) of the class attribute in a causal Bayesian network. The proposed framework is instantiated by two EPs-based classifiers, CE-EP and MB-EP, where CE stands for direct Causes and direct Effects, and MB for Markov Blanket. Extensive experiments on a broad range of data sets validate the effectiveness of the CE-EP and MB-EP classifiers against other well-established methods, in terms of predictive accuracy, pattern numbers, running time, and sensitivity analysis.
School/Discipline
Dissertation Note
Provenance
Description
Link to a related website: http://www.cs.umb.edu/%7Eding/papers/tkde2012.pdf, Open Access via Unpaywall
Access Status
Rights
Copyright 2014 IEEE