University of Tasmania
Browse

File(s) under permanent embargo

The practical value of the standard error of measurement in borderline pass/fail decisions

journal contribution
posted on 2023-05-18, 03:41 authored by Richard HaysRichard Hays, Sen Gupta, T, Veitch, J

OBJECTIVE: The purpose of this study was to explore the value of the standard error of measurement (SEM) in making decisions about students with examination scores at or below the pass/fail borderline in a new undergraduate medical course with an integrated assessment programme.

METHODS: An analysis of de-identified, pooled data for borderline candidates was conducted to determine the SEM for each examination and the progress of candidates according to four score bands, from pass score +/- 1 SEM, 1-2 SEM below the pass score, 2-3 SEM below the pass score and > 3 SEM below the pass score. The impact of poor performance in individual subject areas was also measured.

RESULTS: Data for 1571 candidates were included in the analysis, identifying 132 students with borderline or lower scores, 45% of which were > 1 SEM below the pass score. By the third cohort the banding of students according to the SEM became highly predictive of candidate progress either through immediate remediation and re-sit examination, or by repetition of the year or withdrawal from the course.

CONCLUSIONS: The SEM is a useful tool for making confident and defensible decisions about how to manage candidates with examination scores at or below the borderline mark, as long as attention is paid to established examination design principles. The improved defensibility can be used to support a patient-safety focused decision tree or similar decision support model.

History

Publication title

Medical Education

Volume

42

Issue

8

Pagination

810-5

ISSN

0308-0110

Department/School

Tasmanian School of Medicine

Publisher

Blackwell Publishing Ltd

Place of publication

9600 Garsington Rd, Oxford, England, Oxon, Ox4 2Dg

Rights statement

Copyright 2008 Blackwell Publishing Ltd.

Repository Status

  • Restricted

Socio-economic Objectives

Learner and learning not elsewhere classified

Usage metrics

    University Of Tasmania

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC