Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Journal article
Title: A benchmarking approach for comparing data splitting methods for modeling water resources parameters using artificial neural networks
Author: Wu, W.
May, R.
Maier, H.
Dandy, G.
Citation: Water Resources Research, 2013; 49(11):7598-7614
Publisher: Amer Geophysical Union
Issue Date: 2013
ISSN: 0043-1397
Statement of
Wenyan Wu, Robert J. May, Holger R. Maier, and Graeme C. Dandy
Abstract: <jats:p>Data splitting is an important step in the artificial neural network (ANN) development process, whereby the available data are divided into training, testing, and validation subsets to ensure good generalization ability of the model. Considering that only one split of the data is typically used when developing ANN models, data splitting has a significant impact on model performance, depending on which data are allocated to the three subsets. Therefore, it is important to find a data splitting method that consistently results in predictive validation errors that are representative of the predictive errors obtained over the full range of the available data. This paper addresses this issue by introducing a benchmarking approach for comparing different data splitting methods in terms of (1) bias, which is the difference between the <jats:italic>expected</jats:italic> validation performance over the entire data set and that obtained using a particular data splitting method and (2) variability, which is the spread of the validation errors obtained by repeated implementation of that method. The utility of the proposed approach is assessed on a number of well‐known data splitting methods in the context of four water resources ANN modelling problems. The results obtained indicate that the proposed approach for comparing data splitting methods is more representative than the previous approach where a value of zero is used as the predictive performance benchmark, as it can avoid the selection of an over‐optimistic data splitting method that under‐represents extreme data in the validation set.</jats:p>
Keywords: artificial neural networks
data variability
data splitting methods
Rights: ©2013. American Geophysical Union. All Rights Reserved.
DOI: 10.1002/2012WR012713
Published version:
Appears in Collections:Aurora harvest 4
Civil and Environmental Engineering publications

Files in This Item:
There are no files associated with this item.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.