LoPAD: A local prediction approach to anomaly detection
Date
2020
Authors
Lu, S.
Liu, L.
Li, J.
Le, T.D.
Liu, J.
Editors
Lauw, H.W.
Wong, R.C.W.
Ntoulas, A.
Lim, E.P.
Ng, S.K.
Pan, S.J.
Wong, R.C.W.
Ntoulas, A.
Lim, E.P.
Ng, S.K.
Pan, S.J.
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2020 / Lauw, H.W., Wong, R.C.W., Ntoulas, A., Lim, E.P., Ng, S.K., Pan, S.J. (ed./s), vol.12085, pp.660-673
Statement of Responsibility
Conference Name
24th Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2020 (11 May 2020 - 14 May 2020 : Singapore)
Abstract
Dependency-based anomaly detection methods detect anomalies by looking at the deviations from the normal probabilistic dependency among variables and are able to discover more subtle and meaningful anomalies. However, with high dimensional data, they face two key challenges. One is how to find the right set of relevant variables for a given variable from the large search space to assess dependency deviation. The other is how to use the dependency to estimate the expected value of a variable accurately. In this paper, we propose the Local Prediction approach to Anomaly Detection (LoPAD) framework to deal with the two challenges simultaneously. Through introducing Markov Blanket into dependency-based anomaly detection, LoPAD decomposes the high dimensional unsupervised anomaly detection problem into local feature selection and prediction problems while achieving better performance and interpretability. The framework enables instantiations with off-the-shelf predictive models for anomaly detection. Comprehensive experiments have been done on both synthetic and real-world data. The results show that LoPAD outperforms state-of-the-art anomaly detection methods
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
Copyright 2020 Springer