Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Journal article
Title: An efficient protocol for the global sensitivity analysis of stochastic ecological models
Author: Prowse, T.
Bradshaw, C.
Delean, S.
Cassey, P.
Lacy, R.
Wells, K.
Aiello-Lammens, M.
Akçakaya, H.
Brook, B.
Citation: Ecosphere, 2016; 7(3):e01238-1-e01238-17
Publisher: Wiley
Issue Date: 2016
ISSN: 2150-8925
Statement of
Thomas A. A. Prowse, Corey J. A. Bradshaw, Steven Delean, Phillip Cassey, Robert C. Lacy, Konstans Wells, Matthew E. Aiello-Lammens, H. R. Akçakaya, and Barry W. Brook
Abstract: Stochastic simulation models requiring many input parameters are widely used to inform the management of ecological systems. The interpretation of complex models is aided by global sensitivity analysis, using simulations for distinct parameter sets sampled from multidimensional space. Ecologists typically analyze such output using an “emulator”; that is, a statistical model used to approximate the relationship between parameter inputs and simulation outputs and to derive sensitivity measures. However, it is typical for ad hoc decisions to be made regarding: (1) trading off the number of parameter samples against the number of simulation iterations run per sample, (2) determining whether parameter sampling is sufficient, and (3) selecting an appropriate emulator. To evaluate these choices, we coupled different sensitivity-analysis designs and emulators for a stochastic, 20-parameter model that simulated the re-introduction of a threatened species subject to predation and disease, and then validated the emulators against new output generated from the simulation model. Our results lead to the following sensitivity analysis-protocol for stochastic ecological models. (1) Run a single simulation iteration per parameter sample generated, even if the focal response is a probabilistic outcome, while sampling extensively across the parameter space. In contrast to designs that invested in many model iterations (tens to thousands) per parameter sample, this approach allowed emulators to capture the input-output relationship of the simulation model more accurately and also to produce sensitivity measures that were robust to variation inherent in the parameter-sampling stage. (2) Confirm that parameter sampling is sufficient, by emulating subsamples of the sensitivity-analysis output. As the subsample size is increased, the cross-validatory performance of the emulator and sensitivity measures derived from it should exhibit asymptotic behavior. This approach can also be used to compare candidate emulators and select an appropriate interaction depth. (3) If required, conduct further simulations for additional parameter samples, and then report sensitivity measures and illustrate key response curves using the selected emulator. This protocol will generate robust sensitivity measures and facilitate the interpretation of complex ecological models, while minimizing simulation effort.
Keywords: Boosted regression trees; ecological model; emulator; global sensitivity analysis; metamodel; parameter uncertainty; population growth rate; probability of extinction; species interactions
Rights: © 2016 Prowse et al. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
DOI: 10.1002/ecs2.1238
Grant ID:
Appears in Collections:Aurora harvest 3
Earth and Environmental Sciences publications

Files in This Item:
File Description SizeFormat 
hdl_98904.pdfPublished version1.07 MBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.