Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Journal article
Title: Reduce or remove: individual sensor reliability profiling and data cleaning
Author: Zhang, Y.
Szabo, C.
Sheng, Q.
Citation: Intelligent Data Analysis, 2016; 20(5):979-995
Publisher: IOS Press
Issue Date: 2016
ISSN: 1088-467X
Statement of
Yihong Zhang, Claudia Szabo and Quan Z. Sheng
Abstract: Environmental sensing using multitudes of wirelessly connected sensors is becoming critical for resolving environmental problems, given recent technology advances in the Internet of Things (IoT). Current environmental sensing projects typically deploy commodity sensors, which are known to be unreliable and prone to produce noisy and erroneous data. Moreover, the majority of current sensor data cleaning techniques have not moved beyond using the mean or the median of spatially correlated readings, thus providing unsatisfying accuracies. In this paper, we propose a sensor reliability-based cleaning method, called Influence Mean (IM), which uses weighted aggregation based on individual sensor reliabilities. We investigate whether reducing or removing unreliable sensors can be more effective to provide accurate cleaning results, by designing and testing respective algorithms on synthetic and real datasets. The experimental results show that our method generally improves the data cleaning accuracy, particularly when the behaviors of unreliable sensors vary drastically from reliable sensors.
Keywords: Data cleaning; internet of things; environmental sensing
Rights: © 2016 – IOS Press and the authors. All rights reserved
DOI: 10.3233/IDA-160853
Appears in Collections:Aurora harvest 8
Computer Science publications

Files in This Item:
File Description SizeFormat 
  Restricted Access
Restricted Access1.54 MBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.