Multidimensional computerized adaptive testing for non-compensatory test structure

Current multidimensional computerized adaptive testing (MCAT) is limited only to linked multiple abilities that can compensate for one another rather than non-compensatory ones. In recognition of the usefulness of MCAT and the complications associated with non-compensatory test structure, we propose extending this model to other types of abilities (non-compensatory ones) and evaluating their performance. Three popular item selection methods are used and compared, namely, the Fisher information method, the mutual information method, and the Kullback-Leibler information method. The simulation results showed that the Fisher information and mutual information methods performed similarly, and both outperformed the Kullback-Leibler information method. Furthermore, it was found that the more stringent the termination criterion and the higher the correlation between the latent traits, the higher the resulting measurement precision and test reliability. Test reliability was very similar across the dimensions, regardless of the correlation between the latent traits and termination criterion. Generally, the difficulties of the administered items were found to be at a lower level than the examinees abilities, which shed light on item bank construction for non-compensatory items. Copyright © EcoSta 2019.