A benchmarking approach for comparing data splitting methods for modeling water resources parameters using artificial neural networks

Simple item page
dc.contributor.authorWu, W.
dc.contributor.authorMay, R.
dc.contributor.authorMaier, H.
dc.contributor.authorDandy, G.
dc.date.issued2013
dc.description.abstract<jats:p>Data splitting is an important step in the artificial neural network (ANN) development process, whereby the available data are divided into training, testing, and validation subsets to ensure good generalization ability of the model. Considering that only one split of the data is typically used when developing ANN models, data splitting has a significant impact on model performance, depending on which data are allocated to the three subsets. Therefore, it is important to find a data splitting method that consistently results in predictive validation errors that are representative of the predictive errors obtained over the full range of the available data. This paper addresses this issue by introducing a benchmarking approach for comparing different data splitting methods in terms of (1) bias, which is the difference between the <jats:italic>expected</jats:italic> validation performance over the entire data set and that obtained using a particular data splitting method and (2) variability, which is the spread of the validation errors obtained by repeated implementation of that method. The utility of the proposed approach is assessed on a number of well‐known data splitting methods in the context of four water resources ANN modelling problems. The results obtained indicate that the proposed approach for comparing data splitting methods is more representative than the previous approach where a value of zero is used as the predictive performance benchmark, as it can avoid the selection of an over‐optimistic data splitting method that under‐represents extreme data in the validation set.</jats:p>
dc.description.statementofresponsibilityWenyan Wu, Robert J. May, Holger R. Maier, and Graeme C. Dandy
dc.identifier.citationWater Resources Research, 2013; 49(11):7598-7614
dc.identifier.doi10.1002/2012WR012713
dc.identifier.issn0043-1397
dc.identifier.issn1944-7973
dc.identifier.orcidWu, W. [0000-0003-3907-1570]
dc.identifier.orcidMaier, H. [0000-0002-0277-6887]
dc.identifier.orcidDandy, G. [0000-0001-5846-7365]
dc.identifier.urihttp://hdl.handle.net/2440/82055
dc.language.isoen
dc.publisherAmer Geophysical Union
dc.rights©2013. American Geophysical Union. All Rights Reserved.
dc.source.urihttps://doi.org/10.1002/2012wr012713
dc.subjectartificial neural networks
dc.subjectdata variability
dc.subjectdata splitting methods
dc.subjectbenchmark
dc.subjectvalidation
dc.titleA benchmarking approach for comparing data splitting methods for modeling water resources parameters using artificial neural networks
dc.typeJournal article
pubs.publication-statusPublished

Files

Collections

Civil and Environmental Engineering publications