Effect of interaction between item format and gender on test score reliability and the psychometric properties

Document Type : Original Article

Author

Department of Psychology, College of Education, Umm Al-Qura University, Makkah Al-Mukarramah, Kingdom of Saudi Arabia.

Abstract

The aim of this study was to investigate the most suitable item format for respondents (male/female) to achieve better psychometric properties.. In addition, the study aimed at investigation of the effect of interaction between item format and gender on the psychometric properties (item difficulty and discrimination) of the test. The researcher utilized the descriptive method to answer the research questions. The researcher constructed an achievement test consisted of three item formats(multiple choice, true and false ,completion). The test initially consisted of 50 items for each format .Each test form was administered using a pilot sample of (81) students to assess test validity and reliability26 students were used for the multiple choice test 28 students for the true – false test 27 students for the completion test. Afteranalyzing the results the test final forms consisted of 33 items each. The sample size of the study was (446) male/ female secondary – stage students in Makkah:226 male, 220 female(3 schools for each gender). The researcher used the following statistical techniques to test the study's hypotheses:classical item difficulty,item discrimination using biserialcorrelation and test score reliability using α-Cronbach and split-half methods using spearman-brown and Gatman.Interaction effect tested using two-way ANOVA and the M-Statistics to test differences in reliability correlation.

Keywords

References

Abu Libdeh, S. M., (2008 AD). Principles of psychological measurement and educational evaluation. Amman: Dar Al-Fikr.
Al-Zamili, A., & Al-Sarmi, A., & Kazem, A., (2009). Concepts and applications in educational assessment and measurement. Amman: Dar Hanin for Publishing and Distribution.
Al-Smadi, A., & Al-Darabe’, M., (2004 AD). Psychological and educational measurement between theory and practice. Karak: Yazid Center for Student Services.
Al-Tariri, A. S., (1997 AD). Psychological and educational measurement. Riyadh: Al-Rasheed Library for Publishing and Distribution.
Al-Nabhan, M., (2004 AD). The basics of measurement in the behavioral sciences. Amman: Dar Al-Shorouk for Publishing and Distribution.
Al-Ali, M., (1989 AD). Comparison between the effect of a multiple test, a short answer test, and a mixture test of the two types in terms of the psychometric properties of the test (honesty and reliability), an unpublished master's thesis, Yarmouk University, Irbid, Jordan.
Abu Alem, R., (1993). Educational Psychology. Kuwait: Dar Al-Qalam
Amreziq, K., (1992). Comparison between the multiple test test and the true and false test, in terms of psychometric properties and the shape of the distribution curve for performance on the test, unpublished master's thesis, University of Jordan, Irbid, Jordan.
Dabek, A., (1998 AD). The effect of paragraph shape and number of alternatives on the psychometric characteristics of the test and its paragraphs, unpublished master's thesis, Yarmouk University, Irbid, Jordan.
Suleiman, S. K., (2001 AD). The effect of the structure of true, false and complementary clauses on the psychometric properties of the test and its clauses, unpublished Ph.D. thesis, University of Khartoum.
Abd al-Hadi, N., (2001 AD). Prudent measurement and evaluation and its use in classroom teaching (2nd ed.). Amman: Wael House for Printing and Publishing.
Allam, S. El., (2002). Educational and psychological measurement and evaluation: its basics, applications, and contemporary directives. Cairo: Arab Thought House.
Atwi, J. E., (2007). Scientific Research Methods (I 2). Amman: House of Culture for Publishing and Distribution.
Melhem, S., (2002). Measurement and evaluation in education and psychology. Amman: Dar Al Masirah for publishing, distribution and printing.
Murad, S. A., (2000 AD). Statistical methods in psychological, educational and social sciences. Cairo: Anglo-Egyptian Library.

Files

Share

How to cite

Statistics