Closing the implementation gap in pre-deployment medical AI study design
| dc.contributor.advisor | Palmer, Lyle | |
| dc.contributor.advisor | Carneiro, Gustavo | |
| dc.contributor.advisor | Bessen, Taryn | |
| dc.contributor.author | Oakden-Rayner, Luke | |
| dc.contributor.school | School of Public Health | en |
| dc.date.issued | 2021 | |
| dc.description.abstract | The rapid development of clinical artificial intelligence, AI, technologies has outpaced the development of robust regulatory and clinical safety mechanisms. AI systems are cleared for use and deployed in practice relying on pre-clinical performance studies, without evidence of the impact this will have on patient and provider outcomes. This has led to concerns of an, implementation gap, where systems that appear to perform well on pre-clinical testing fail to produce the expected outcomes in practice. While there is an urgent need for direct clinical testing of AI systems and evaluation of the impact of these systems on patient and provider outcomes, it is implausible to expect the clinical evaluation will be performed at the scale necessary to mitigate potential AI harms of the many AI systems already in use and currently under development. In this body of work I look at factors which may contribute to the implementation gap, in particular the effects of low-quality training and testing data, flawed and incomplete study design methodologies, and an over-reliance on explainability methods to address safety. I suggest a series of improvements to how we design, evaluate, and utilise AI systems in clinical practice, with the goal of better estimating the potential harms of AI during the pre-clinical testing phase, and by doing so closing the implementation gap. | en |
| dc.description.dissertation | Thesis (Ph.D.) -- University of Adelaide, School of Public Health, 2022 | en |
| dc.identifier.uri | https://hdl.handle.net/2440/136684 | |
| dc.language.iso | en | en |
| dc.provenance | This electronic version is made publicly available by the University of Adelaide in accordance with its open access policy for student theses. Copyright in this thesis remains with the author. This thesis may incorporate third party material which has been used by the author pursuant to Fair Dealing exceptions. If you are the owner of any included third party copyright material you wish to be removed from this electronic version, please complete the take down form located at: http://www.adelaide.edu.au/legals | en |
| dc.subject | Medicine | en |
| dc.subject | Artificial intelligence | en |
| dc.subject | Machine learning | en |
| dc.subject | Safety | en |
| dc.title | Closing the implementation gap in pre-deployment medical AI study design | en |
| dc.type | Thesis | en |
Files
Original bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- Oakden-Rayner2022_PhD.pdf
- Size:
- 8.81 MB
- Format:
- Adobe Portable Document Format
- Description: