Development of an item bank for assessing generic competences in a higher-education institute: A Rasch modelling approach

Qin XIE, Xiaoling ZHONG, Wen Chung WANG, Cher Ping LIM

Research output: Contribution to journalArticlespeer-review

5 Citations (Scopus)

Abstract

This paper describes the development and validation of an item bank designed for students to assess their own achievements across an undergraduate-degree programme in seven generic competences (i.e., problem-solving skills, critical-thinking skills, creative-thinking skills, ethical decision-making skills, effective communication skills, social interaction skills and global perspective). The Rasch modelling approach was adopted for instrument development and validation. A total of 425 items were developed. The content validity of these items was examined via six focus group interviews with target students, and the construct validity was verified against data collected from a large student sample (N = 1151). A matrix design was adopted to assemble the items in 26 test forms, which were distributed at random in each administration session. The results demonstrated that the item bank had high reliability and good construct validity. Cross-sectional comparisons of Years 1–4 students revealed patterns of changes over the years. Correlation analyses shed light on the relationships between the constructs. Implications are drawn to inform future efforts to develop the instrument, and suggestions are made regarding ways to use the instrument to enhance the teaching and learning of generic skills. Copyright © 2013 HERDSA.
Original languageEnglish
Pages (from-to)821-835
JournalHigher Education Research & Development
Volume33
Issue number4
Early online dateDec 2013
DOIs
Publication statusPublished - 2014

Citation

Xie, Q., Zhong, X., Wang, W.-C., & Lim, C. P. (2014). Development of an item bank for assessing generic competences in a higher-education institute: A Rasch modelling approach. Higher Education Research & Development, 33(4), 821-835.

Keywords

  • Generic skills
  • Higher education
  • Instrument development
  • Rasch modelling
  • Teaching Development Grant (TDG)
  • TDG project code: T3336
  • Period: TDG 2008-2009
  • Teaching Development Grant (TDG) Output

Fingerprint Dive into the research topics of 'Development of an item bank for assessing generic competences in a higher-education institute: A Rasch modelling approach'. Together they form a unique fingerprint.