Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Journal article
Title: The assessment of a structured online formative assessment program: a randomised controlled trial
Author: Palmer, E.
Devitt, P.
Citation: BMC Medical Education, 2014; 14(1):8-1-8-10
Publisher: BioMed Central
Issue Date: 2014
ISSN: 1472-6920
Statement of
Edward Palmer and Peter Devitt
Abstract: BACKGROUND: Online formative assessment continues to be an important area of research and methods which actively engage the learner and provide useful learning outcomes are of particular interest. This study reports on the outcomes of a two year study of medical students using formative assessment tools. METHOD: The study was conducted over two consecutive years using two different strategies for engaging students. The Year 1 strategy involved voluntary use of the formative assessment tool by 129 students. In Year 2, a second cohort of 130 students was encouraged to complete the formative assessment by incorporating summative assessment elements into it. Outcomes from pre and post testing students around the formative assessment intervention were used as measures of learning. To compare improvement scores between the two years a two-way Analysis of Variance (ANOVA) model was fitted to the data. RESULTS: The ANOVA model showed that there was a significant difference in improvement scores between students in the two years (mean improvement percentage 19% vs. 38.5%, p < 0.0001). Students were more likely to complete formative assessment items if they had a summative component. In Year 2, the time spent using the formative assessment tool had no impact on student improvement, nor did the number of assessment items completed. CONCLUSION: The online medium is a valuable learning resource, capable of providing timely formative feedback and stimulating student-centered learning. However the production of quality content is a time-consuming task and careful consideration must be given to the strategies employed to ensure its efficacy. Course designers should consider the potential positive impact summative components to formative assessment may have on student engagement and outcomes.
Keywords: Analysis of Variance; Program Evaluation; Learning; Education, Distance; Education, Medical, Undergraduate; Educational Measurement; Students, Medical; Computer-Assisted Instruction; Online Systems; Australia
Rights: © 2014 Palmer and Devitt; licensee BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
RMID: 0030009806
DOI: 10.1186/1472-6920-14-8
Appears in Collections:Education publications

Files in This Item:
File Description SizeFormat 
hdl_97394.pdfPublished version422.6 kBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.