Exploring the impact of data splitting methods on artificial neural network models

Simple item page
dc.contributor.authorWu, W.
dc.contributor.authorMaier, H.
dc.contributor.authorDandy, G.
dc.contributor.authorMay, R.
dc.contributor.conferenceInternational Conference on Hydroinformatics (10th : 2012 : Hamburg, Germany)
dc.date.issued2012
dc.description.abstractData splitting is an important step in the artificial neural network (ANN) development process whereby data is divided into training, test and validation subsets to ensure good generalization ability of the model. In previous research, guidelines on choosing a suitable data splitting method based on the dimensionality and distribution of the dataset were derived from results obtained using synthetic datasets. This study extends previous research by investigating the impact of three data splitting methods tested in previous research on the predictive performance of ANN models using real-world datasets. Three real-world water resources datasets with varying statistical properties are used. It has been found that the relationship between different data splitting methods and data with different statistical properties obtained in previous research using synthetic data also generally holds for realworld water resources data. However, some data splitting methods produce an optimistically low validation error due to the bias created by allocating the extreme observations to the training set.
dc.description.statementofresponsibilityWenyan Wu, Holger R. Maier, Graeme C. Dandy and Robert May
dc.description.urihttp://www.wqra.com.au/research-strategy/issue-details/49
dc.identifier.citationProceedings of the 10th International Conference on Hydroinformatics: Understanding Changing Climate and Environment and Finding Solutions, held in Hamburg, Germany, 14-18 July, 2012: pp.1-8
dc.identifier.orcidWu, W. [0000-0003-3907-1570]
dc.identifier.orcidMaier, H. [0000-0002-0277-6887]
dc.identifier.orcidDandy, G. [0000-0001-5846-7365]
dc.identifier.urihttp://hdl.handle.net/2440/77610
dc.language.isoen
dc.publisherHIC2012
dc.publisher.placeCD
dc.rightsCopyright status unknown
dc.titleExploring the impact of data splitting methods on artificial neural network models
dc.typeConference paper
pubs.publication-statusPublished

Files

Collections

Civil and Environmental Engineering publications
Environment Institute publications