Current studentsExisting staffContact us
 

Validation and reliability testing of a rating scale for objective assessment of performance in laparoscopic appendicectomy surgery

Simple item page
dc.contributor.authorSirimanna, P.
dc.contributor.authorRavindran, P.
dc.contributor.authorSmigielski, M.
dc.contributor.authorGladman, M.A.
dc.contributor.authorNaganathan, V.
dc.date.issued2022
dc.descriptionFirst published: 24 June 2022
dc.description.abstractBackgrounds: To achieve a competency-based training paradigm, the ability to obtain reliable and valid quantitative assessments of intraoperative performance is required. Through this, weaknesses can be identified and practiced, and competency assessed. This study aimed to determine the validity and reliability an objective evaluation tool for assessment of performance in laparoscopic appendicectomy (LA). Methods: A prospective single-blinded observational study design was used. Videos of inexperienced (performed <10 LAs) and experienced (performed >100 LAs) surgeons per-forming LA surgery were collected. Surgical performance during each recording was rated by two independent, blinded expert surgeons using the LA Rating Scale (LARS) and the modified Objective Structured Assessment of Technical Skill (OSATS) scale. Results: The intraclass correlation coefficient (ICC) for LARS was 0.95 (95%CI 0.83–0.98). The ICC for each step ranged from 0.48 to 0.90, and the test–retest ICC for LARS was 0.91 (95%CI 0.69–0.98). Significant differences (P< 0.001) between median performance scores as rated by LARS were observed between the inexperienced and experienced surgeons. A Spearman’s correlation coefficient of 0.87 (P< 0.001) was observed between LARS performance scores and modified OSATS scores. Conclusion: LARS demonstrated excellent inter-rater and test–retest reliability, and con-struct and concurrent validity and can be used to quantitatively evaluate performance during LA. This can potentially allow specific weaknesses to be identified and improved upon through deliberate practice. Progress can be tracked through re-evaluation and scores of expert surgeons can be used as performance goals for credentialing in LA.
dc.description.statementofresponsibilityPramudith Sirimanna, Praveen Ravindran, Michelle Smigielski, Marc A Gladman, and Vasi Naganathan
dc.identifier.citationANZ Journal of Surgery, 2022; 92(7):1731-1736
dc.identifier.doi10.1111/ans.17862
dc.identifier.issn1445-1433
dc.identifier.issn1445-2197
dc.identifier.orcidGladman, M.A. [0000-0001-8412-9570]
dc.identifier.urihttps://hdl.handle.net/2440/135790
dc.language.isoen
dc.publisherWiley
dc.relation.granthttp://purl.org/au-research/grants/nhmrc/GNT1093784
dc.rights© 2022 The Authors.ANZ Journal of Surgery published by John Wiley & Sons Australia, Ltd on behalf of Royal Australasian College of Surgeons. This is an open access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made.
dc.source.urihttps://doi.org/10.1111/ans.17862
dc.subjectcompetency-based training; laparoscopic appendicectomy; rating scales; surgical education; technical skills assessment
dc.titleValidation and reliability testing of a rating scale for objective assessment of performance in laparoscopic appendicectomy surgery
dc.typeJournal article
pubs.publication-statusPublished

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
hdl_135790.pdf
Size:
453.33 KB
Format:
Adobe Portable Document Format
Description:
Published version
Download

Collections

Medicine publications