Systematic reviewers' perspectives on replication of systematic reviews: A survey
Files
(Published version)
Date
2023
Authors
Nguyen, P.
McKenzie, J.E.
Hamilton, D.G.
Moher, D.
Tugwell, P.
Fidler, F.M.
Haddaway, N.R.
Higgins, J.P.T.
Kanukula, R.
Karunananthan, S.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
Cochrane Evidence Synthesis and Methods, 2023; 1(2):e12009-1-e12009-15
Statement of Responsibility
Phi-Yen Nguyen, Joanne E. McKenzie, Daniel G. Hamilton, David Moher, Peter Tugwell, Fiona M. Fidler, Neal R. Haddaway, Julian P. T. Higgins, Raju Kanukula, Sathya Karunananthan, Lara J. Maxwell, Steve McDonald, Shinichi Nakagawa, David Nunan, Vivian A. Welch, Matthew J. Page
Conference Name
Abstract
Background: Replication is essential to the scientific method. It is unclear what systematic reviewers think about the replication of systematic reviews (SRs). Therefore, we aimed to explore systematic reviewers' perspectives on (a) the definition and importance of SR replication; (b) incentives and barriers to conducting SR replication; and (c) a checklist to guide when to replicate an SR. Methods: We searched PubMed for SRs published from January to April 2021, from which we randomly allocated 50% to this survey and 50% to another survey on data sharing in SRs. We sent an electronic survey to authors of these SRs (n = 4669) using Qualtrics. Quantitative responses were summarized using frequency analysis. Free‐text answers were coded using an inductive approach. Results: The response ratewas 9%(n = 409).Most participants considered “replication of SRs” as redoing an SR (68%) or reanalyzing originally collected data (61%), using the same or similar methods. Participants also considered updating an SR, either one's own (42%) or others (43%), equivalent to replication. Most participants agreed that replication of SRs is important (89%). Although 54% of participants reported having conducted a replication of a SR, only 22% have published a replication within 5 years. Those who published a replication (n = 89) often found their replication supported (47%) or expanded the generalizability of the original review (51%). The most common perceived barriers to replicating SRs were difficulty publishing (75%), less prestige (65%), fewer citations (56%), and less impact on career advancement (55%) compared to conducting an original SR. A checklist to assess the need for replication was deemed useful (79%) and easy to apply in practice (69%) by participants. Conclusion: Reviewers have various perceptions of what constitutes a replication of SRs. Reviewers see replication as important and valuable but perceive several barriers to conducting replications. Institutional support should be better communicated to reviewers to address these perceptions.
School/Discipline
Dissertation Note
Provenance
Description
[Correction added on 12 July 2023, after first online publication: The copyright line was changed.]
Access Status
Rights
© 2023 The Authors. Cochrane Evidence Synthesis and Methods published by John Wiley & Sons Ltd on behalf of The Cochrane Collaboration. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.