The weakness of fragility index exposed in an analysis of the traumatic brain injury management guidelines: A meta-epidemiological and simulation study

Files

hdl_146042.pdf (1.33 MB)
  (Published version)

Date

2020

Authors

Condon, T.M.
Sexton, R.W.
Wells, A.J.
To, M.S.

Editors

Pasin, L.

Advisors

Journal Title

Journal ISSN

Volume Title

Type:

Journal article

Citation

PLoS ONE, 2020; 15(8):e0237879-1-e0237879-14

Statement of Responsibility

Thomas M. Condon, Richard W. Sexton, Adam J. Wells, Minh-Son To

Conference Name

Abstract

Objectives: To perform fragility index (FI) analysis on the evidence that forms the basis of the guidelines for the management of severe traumatic brain injury (TBI), and develop a deeper understanding of the pitfalls associated with FI. Design: Meta-epidemiological analysis and numerical simulations. Methods: The Brain Trauma Foundation guidelines (4th edition) for management of severe TBI were used to identify relevant randomised controlled trials (RCTs). FI based on Fisher’s exact test and relative risk was performed on eligible RCTs. The relationship between FI, event counts and P values was explored by exhaustively considering different combinations of outcomes for studies of total size ranging from 80 to 10000. Sample size calculations were also performed for a range of power, baseline risk and relative risk, to determine the influence of study design on FI. Results: FI analysis of the severe TBI management guidelines revealed that most studies were associated with a low FI. In the majority of studies, FI was of a similar magnitude to the number lost to follow-up. The simulations revealed that while FI was inversely related to P value, a wide range of FI may be associated with a given P value. FI is also affected by sample size, baseline risk and effect size. Sample size calculations suggest that aside from very high-powered studies, most are likely to yield low FI values in the range typically encountered in the literature. Conclusions: Many studies are underpowered and are expected to be associated with a small FI. Furthermore, FI over-simplifies the complex, non-linear relationships between sample size, effect size and P value, which hinder comparisons of FI between studies. FI places undue importance on the “significance” of P values and accordingly should only be used sparingly.

School/Discipline

Dissertation Note

Provenance

Description

Access Status

Rights

© 2020 Condon et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

License

Grant ID

Call number

Persistent link to this record