Business School publications
Permanent URI for this collection
Browse
Browsing Business School publications by Author "Abraham, A."
Now showing 1 - 3 of 3
Results Per Page
Sort Options
Item Restricted Does calibration reduce variability in the assessment of accounting learning outcomes?(Taylor & Francis, 2016) O Connell, B.; De Lange, P.; Freeman, M.; Hancock, P.; Abraham, A.; Howieson, B.; Watty, K.Reliable, consistent assessment process that produces comparable assessment grades between assessors and institutions is a core activity and an ongoing challenge with which universities have failed to come to terms. In this paper, we report results from an experiment that tests the impact of an intervention designed to reduce grader variability and develop a shared understanding of national threshold learning standards by a cohort of reviewers. The intervention involved consensus moderation of samples of accounting students’ work, with a focus on three research questions. First, what is the quantifiable difference in grader variability on the assessment of learning outcomes in ‘application skills’ and ‘judgement’? Second, does participation in the workshops lead to reduced disparity in the assessment of the students’ learning outcomes in ‘application skills’ and ‘judgement’? Third, does participation in the workshops lead to greater confidence by reviewers in their ability to assess students’ skills in application skills and judgement? Our findings suggest consensus moderation does reduce variability across graders and also builds grader confidence.Item Restricted Social moderation, assessment and assuring standards for accounting graduates(Carfax Publishing Ltd, 2014) Watty, K.; Freeman, M.; Howieson, B.; Hancock, P.; O'Connell, B.; De Lange, P.; Abraham, A.Evidencing student achievement of standards is a growing imperative worldwide. Key stakeholders (including current and prospective students, government, regulators and employers) want confidence that threshold learning standards in an accounting degree have been assured. Australia’s new higher education regulatory environment requires that student achievements are benchmarked against intended programme learning outcomes, guided by published disciplinary standards and a national qualifications framework, and against other higher education providers. Here, we report on a process involving academics from 10 universities, aided by professional practitioners, to establish and equip assessors to reliably assure threshold learning standards in accounting that are nationally comparable. Importantly, we are learning more about how standards are interpreted. Based on the premise that meaning is constructed from tacit experiences, social interactions and intentional reflection on explicit information, we report outcomes of three multi-part calibration interventions, situated around judgements of the quality of the written communication skills exhibited in student work and their related assessment tasks. Qualitative data from 30 participants in the calibration process suggest that they perceive that the process both assists them both in developing a shared understanding of the accounting threshold learning standards and in the redesign of assessment tasks to more validly assess the threshold learning standards.Item Metadata only Using technology to improve peer review and collaborative conversations to benchmark academic standards(IEEE, 2012) Freeman, M.; Willey, K.; Hancock, P.; Howieson, B.; Watty, K.; Abraham, A.; O'Connell, B.; Frontiers in Education Conference (42nd : 2012 : Seattle, Washington, U.S.A.)In 2010 the Australian government commissioned the Australian Learning and Teaching Council (ALTC) to undertake a national project to facilitate disciplinary development of threshold learning standards. The aim was to lay the foundation for all higher education providers to demonstrate to the new national higher education regulator, the Tertiary Education Quality and Standards Agency (TEQSA), that graduates achieved or exceeded minimum academic standards. Through a yearlong consultative process, representatives of employers, professional bodies, academics and students, developed learning standards applying to any Australian higher education provider. Willey and Gardner reported using a software tool, SPARKPLUS, in calibrating academic standards amongst teaching staff in large classes. In this paper, we investigate the effectiveness of this technology to promote calibrated understandings with the national accounting learning standards. We found that integrating the software with a purposely designed activity provided significant efficiencies in calibrating understandings about learning standards, developed expertise and a better understanding of what is required to meet these standards and how best to demonstrate them. The software and supporting calibration and assessment process can be adopted by other disciplines, including engineering, seeking to provide direct evidence about performance against learning standards.