Factorial, convergent, and discriminant validity of timss math and science motivation measures: A comparison of Arab and Anglo-Saxon countries

Herbert W. MARSH, Adel Salah ABDULJABBAR, Maher M. ABU-HILAL, Alexandre J. S. MORIN, Faisal ABDELFATTAH, Kim Chau Charles LEUNG, Man K. XU, Benjamin NAGENGAST, Philip PARKER

Research output: Contribution to journalArticle

71 Citations (Scopus)

Abstract

For the international Trends in International Mathematics and Science Study (TIMSS2007) math and science motivation scales (self-concept, positive affect, and value), we evaluated the psychometric properties (factor structure, method effects, gender differences, and convergent and discriminant validity) in 4 Arab-speaking countries (Saudi Arabia, Jordan, Oman, and Egypt) and 4 English-speaking Anglo-Saxon countries (United States, England, Australia, and Scotland). In this article, we also highlight methodological weaknesses in the TIMSS approach to these motivation measures. We found reasonable support for within-group invariance across the math and science domains and between-group invariance across countries for full factor loading invariance and partial item intercept invariance. However, the factor structure is complicated by strong negative-item method effects and correlated unique characteristics associated with the use of math and science items with parallel wording. Correlations involving the motivation factors were reasonably similar across countries, supporting both discriminant and convergent validity in relation to achievement, plans to take more coursework in math and science, and long-term educational aspirations. However, gender differences largely favor girls in the Arab countries (with strong single-sex education systems) relative to Anglo countries (and international norms). The juxtapositions of latent mean differences in achievement and motivation factors are perplexing; students from Anglo countries had substantially higher achievement than students from Arab countries but had substantially lower motivation across all 8 math and science factors. Copyright © 2012 American Psychological Association.
Original languageEnglish
Pages (from-to)108-128
JournalJournal of Educational Psychology
Volume105
Issue number1
Early online dateSep 2012
DOIs
Publication statusPublished - Feb 2013

Fingerprint

Motivation
Middle East
science
Arab countries
speaking
gender-specific factors
mathematics studies
Oman
Students
sex education
Saudi Arabia
science studies
Jordan
self-concept
Sex Education
Mathematics
Egypt
psychometrics
education system
Scotland

Citation

Marsh, H. W, Abduljabbar, A. S., Abu-Hilal, M. M., Morin, A. J. S., Abdelfattah, F., Leung. K. C., et al. (2013). Factorial, convergent, and discriminant validity of timss math and science motivation measures: A comparison of Arab and Anglo-Saxon countries. Journal of Educational Psychology, 105(1), 108-128.

Keywords

  • Math and science motivation
  • Trends in international mathematics and science study
  • Math and science gender difference
  • Negative item method effects
  • Cross-cultural measurement invariance