Assessing the distinguishability of models and the informativeness of data
Files
(Accepted version)
Date
2004
Authors
Navarro, D.
Pitt, M.
Myung, J.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
Cognitive Psychology, 2004; 49(1):47-84
Statement of Responsibility
Daniel J. Navarro, Mark A. Pitt, and In Jae Myung
Conference Name
Abstract
A difficulty in the development and testing of psychological models is that they are typically evaluated solely on their ability to fit experimental data, with little consideration given to their ability to fit other possible data patterns. By examining how well model A fits data generated by model B, and vice versa (a technique that we call landscaping), much safer inferences can be made about the meaning of a model’s fit to data. We demonstrate the landscaping technique using four models of retention and 77 historical data sets, and show how the method can be used to: (1) evaluate the distinguishability of models, (2) evaluate the informativeness of data in distinguishing between models, and (3) suggest new ways to distinguish between models. The generality of the method is demonstrated in two other research areas (information integration and categorization), and its relationship to the important notion of model complexity is discussed.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
Copyright © 2004 Elsevier Inc. All rights reserved.