On moving from structured oral assessments to computer-aided assessments for vocational training
conference contribution
posted on 2023-05-23, 07:32authored byAdair, D, Jaeger, M
Included in methods commonly used for assessing knowledge and skills associated with vocational training are structured oral assessments (SOAs) since they can be used to assess knowledge and skills to a depth rarely achieved in other forms of testing. However, SOAs require considerable preparation by the assessors, they can be restricted by time and assessor allocation, it is difficult to cover the course and they can put stress on the examinees. Computer-aided tests have merits and problems. They are efficient and straightforward to run, and they give an assessment environment which is less stressful than SOAs, but, they have a disadvantage in that students will on occasions guess answers when multiple-choice questions (MCQs) are used. Two electronic assessment methods are developed here, one using a scoring method and the other using a set of pairs of MCQs with both designed to counteract examinee guessing. A comparison of the four assessment results follows for three cohorts of students, namely, the results from an SOA, the results of the electronic assessment method using the “scoring method”, the results of the electronic assessment method using the “set-of-pairs” method and the results of an electronic assessment method using the traditional “positive-grades-only” scoring rules.
History
Publication title
Proceedings of the International Conference on Engineering Education 2012
Volume
Part I
Editors
J Björkqvist, M-J Laakso, J Roslöf, R Tuohi and S Virtanen
Pagination
28-35
ISBN
978-952-216-316-5
Department/School
School of Engineering
Publisher
Turku University of Applied Sciences
Place of publication
Turku, Finland
Event title
International Conference on Engineering Education 2012
Event Venue
Turku, Finland
Date of Event (Start Date)
2012-07-30
Date of Event (End Date)
2012-08-03
Rights statement
Copyright 2012 International Conference on Engineering Education
Repository Status
Restricted
Socio-economic Objectives
Other education and training not elsewhere classified