Validating onscreen marking in Hong Kong

Research output: Contribution to journalArticles

5 Citations (Scopus)

Abstract

This paper details an investigation into onscreen marking (OSM) in Hong Kong—where paper-based marking is being phased out, being completely superseded by OSM. The study described involved 30 raters who had previously rated English language essay scripts on screen in the 2007 Hong Kong Certificate of Education examination. In the current study, the 30 raters re-rated (unbeknown to them) 100 scripts they had rated in the 2007 examination. Using multi-faceted Rasch measurement, a five-faceted design was employed, modelling raters, test takers, input prompt materials, rating scales, and, especially, the marking medium. Results showed that all factors generally exhibited good data fit. With the method of marking, the major facet for investigation, logit values emerged which were both very close to zero. The hypothesis that the method of marking does not intrude on scores awarded to test takers when scripts are marked on screen or on paper was therefore accepted. Given that in 2012, all public examinations in Hong Kong will be marked solely on screen, results from the current study suggest that the scores returned from the OSM marking system will be able to be considered as reliable as those obtained from paper-based marking. Copyright © 2010 Education Research Institute, Seoul National University, Seoul, Korea.
Original languageEnglish
Pages (from-to)423-431
JournalAsia Pacific Education Review
Volume11
Issue number3
DOIs
Publication statusPublished - Sep 2010

Citation

Coniam, D. (2009). Validating onscreen marking in Hong Kong. Asia Pacific Education Review, 11(3), 423-431. doi: 10.1007/s12564-009-9068-2

Keywords

  • Onscreen marking
  • English language
  • Essay marking
  • Multi-faceted Rasch measurement

Fingerprint Dive into the research topics of 'Validating onscreen marking in Hong Kong'. Together they form a unique fingerprint.