Exploring the impact of data splitting methods on artificial neural network models
Date
2012
Authors
Wu, W.
Maier, H.
Dandy, G.
May, R.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
Proceedings of the 10th International Conference on Hydroinformatics: Understanding Changing Climate and Environment and Finding Solutions, held in Hamburg, Germany, 14-18 July, 2012: pp.1-8
Statement of Responsibility
Wenyan Wu, Holger R. Maier, Graeme C. Dandy and Robert May
Conference Name
International Conference on Hydroinformatics (10th : 2012 : Hamburg, Germany)
Abstract
Data splitting is an important step in the artificial neural network (ANN) development process whereby data is divided into training, test and validation subsets to ensure good generalization ability of the model. In previous research, guidelines on choosing a suitable data splitting method based on the dimensionality and distribution of the dataset were derived from results obtained using synthetic datasets. This study extends previous research by investigating the impact of three data splitting methods tested in previous research on the predictive performance of ANN models using real-world datasets. Three real-world water resources datasets with varying statistical properties are used. It has been found that the relationship between different data splitting methods and data with different statistical properties obtained in previous research using synthetic data also generally holds for realworld water resources data. However, some data splitting methods produce an optimistically low validation error due to the bias created by allocating the extreme observations to the training set.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
Copyright status unknown