The uniform and non-uniform differential performance of the Corona Panic Disorder Scale items across gender on samples from the Arab community

Document Type : Original Article

Author

Department of Psychology, College of Humanities and Administrative Sciences, Unaizah.

Abstract

        This study aimed to explore the uniform and non-uniform differential performance of the Corona Panic Disorder Scale items across gender on samples from the Arab community. The basic sample was (2285) participants (815 males and 1470 females), the panic disorder of Corona virus scale (Fath Allah et al., 2021) was conduct. Results showed that according to the criteria of the Rasch-Mantel-Haenszel method 56% of the scale items showed DIP. According to the criteria of the Rasch-Wolsh method and chi-square (40) items demonstrated DIP. According to the method of area under the item characteristics curve (30) items showed DIP. The Rasch-Mantel-Haenszel method demonstrated that (13) items showed UDIP (17%), and according to the criteria of the Rasch-Wolsh method (40) items (58%) demonstrated UDIP. According of area under the item characteristics curve all itms showed UDIP except for (18) items, While the chi-square method showed (51) items demonstrated UDIP. The results were interpreted and recommendations were presented.

Keywords


Kamel, Ibrahim, Asmaa Abdelkhalek (2022). Differential Item Functioning Analysis of Academic Responsibility Scale Items among University Students based on Academic Major using Mantel-Haenszel Generalized Method. Beni Suef University Journal of Education, 19(115), 69-73.
Masra, Abu, Ayat; Al-Sawalma, Youssef (2021). Using the Rasch Trees Method to Detect Differential Item Performance of National Mathematics Exam Items for Fourth-Grade Students in Jordan. Jordanian Journal of Educational Sciences, 17(1), 119-134.
Ijbara, Mohammed (2015). The Impact of Differential Item Functioning Percentage on Type I Error and Test Power using Logistic Regression and Odds Ratio. Doctoral Dissertation, Yarmouk University.
Oula, Bushra; Al-Matarneh, Ahmed (2018). Differential Performance of Items in the Proficiency Test in the English Language Applied to Mutah University Students. Journal of Educational and Psychological Sciences, 19(2), 449-475.
Al-Bursan, Ismail Salama Suleiman (2013). Differential Performance by Gender on the National Mathematics Test for Adjusting the Quality of Education for Tenth-Grade Students. Educational and Psychological Studies, Zagazig University, (79), 229-270.
Al-Bustanji, Mahmoud (2004). Comparison of Four Methods for Detecting Differential Performance by Gender in Items of a Special Mental Abilities Test for the Age Group "15-16" in Jordan. Doctoral Dissertation, Arab Open University.
Al-Batoush, Ali (2018). Examining Differential Performance of Items in the Teaching Performance Assessment Tool According to Gender and Academic Level at Yarmouk University using Mantel-Haenszel Generalized Method. Doctoral Dissertation, Yarmouk University.
Bakri, Jihan Mohamed (2020). Psychological Disorders Resulting from Physical Distancing due to the COVID-19 Pandemic and their Relationship to the Big Five Personality Factors among University Students. Educational Journal of the Faculty of Education, Sohag University, 2(86), 600-668.
Belhassini, Warda Rashid (2014). Panic Disorder and the Cognitive Behavioral Therapy Revolution. Dar Al-Shorouk.
Bousalem, Abdelaziz; Krish, Ahmed (2016). Differential Item Performance in Psychological Tests: Sources and Interpretation. Journal of Social Sciences, (17), 127-142.
Al-Taqi, Ahmed Mohamed (2013). Modern Measurement Theory. Al-Maseera Publishing, Distribution, and Printing House.
Altalawi, Rabab Abdelmonem (2023). The Role of Social Media in Spreading the Culture of Panic and Adaptation Associated with the COVID-19 Pandemic. Egyptian Journal of Media Research, (82), 95-160.
Al-Haj Mahmoud, Ferial Mahmoud Mohamed (2018). Differential Performance of Items and Distractors in the Diagnostic Narrative Test in Science for the Sixth Grade Designed according to the Item Response Theory. Open University Research Journal of Humanities and Social Sciences, (44), 123-135.
Al-Harbi, Ala'a Nawaf; Ramzi, Fatima (2021). Detecting the Effect of Differential Vocabulary Performance on the Power and Effectiveness of the Single Curve Test in the Three-Parameter Model. Journal of Educational and Psychological Sciences, 5(14), 46-61.
Al-Khatib, Hussein Mahmoud Ahmed (2015). The Relationship between Differential Item Performance and Test Information Function and its Information Function. Doctoral Dissertation, Faculty of Education, Yarmouk University.
Aldosari, Rashid. (2018). Using Mantel-Haenszel and Logistic Regression Methods to Detect Differential Performance of Items in Mathematics Tests. Journal of the Faculty of Education, 70(2), 241-264.
Rashwan, Rabie Abdo Ahmed (2021). Differential Performance of Items and its Impact on the Differential Performance of the Test using the Item Response Theory Models and Confirmatory Factor Analysis Multigroups. Journal of Educational Sciences and Humanities, (15), 44-93.
Al-Sakarna, Mohammed Noor (2017). Detecting Differential Performance of Items in the Attitude Scale According to the Distribution of Negative Items and the Method of Detection and the Level of Significance. Doctoral Dissertation, Faculty of Education, Yarmouk University.
Al-Sawalma, Youssef; Al-Ajlouni, Jihad (2019). The Relationship between Differential Performance of Distractors and Differential Performance of Items in a Multiple-Choice Type Mathematics Test. Jordanian Journal of Educational Sciences, 15(1), 49-63.
Al-Sharbini, Lotfi (2003). Dictionary of Psychiatric Terms. Kuwait Foundation for the Advancement of Sciences.
Al-Sharifin, Nidal (2018). The Impact of Differential Performance Type on the Psychometric Properties of Items and the Test According to Instructional Models and Non-Instructional Models of the Item Response Theory. Studies - Educational Sciences, 45, 605-632.
Al-Shukri, Hamoud bin Abdullah; Ismail, Mimi El-Sayed Ahmed (2023). Psychometric Properties and Regular and Irregular Differential Performance of the Psychological Weakness Scale using the Rating Scale Model among Students of the College of Education in Rustaq. Journal of Educational Sciences - Sohag College of Education, 113(113), 475-524.
Dada, Heba Abdel-Latif (2023). The Impact of Different Item Response Models "1PL, 2PL, 3PL" on the Differential Performance of the Item. Al-Azhar Journal for Humanities and Social Sciences, 62(1), 23-44.
Dada, Heba; Toman, Manar (2018). Differential Performance of Items in the Standard Sequential Matrices Test according to Gender and Academic Specialization. Journal of Research in Qualitative Education, (17), 211-230.
Zatha, Haider (2006). Effectiveness of the Bias Detection Method in the Arbitration Paragraph Compared to Experimental Methods Based on Classical Test Theory and Item Response Theory. Doctoral Dissertation, University of Jordan.
Amer, Abdulnasser. (2020). "Psychometric Properties of the Coronavirus Fear Scale (COVID-19) in the Arab Community." Arab Journal of Security Studies, 36(2), 88-177.
Abdulqadir, Kauthar Ibrahim (2020). Differential Performance of Items and Distractors: A Developmental Study of a Critical Thinking Test at the University Level. Doctoral Dissertation, Faculty of Education, Yarmouk University.
Abdullah, Ziad Ahmed (2022). Impact of Sample Size on the Differential Performance of the Item According to the Item Response Theory. Journal of Educational and Psychological Research, (72), 119-143.
Abdelmotei, Saed Abdelkhalek (2023). Regular and Irregular Differential Performance of Items in the Auditory and Visual Attention Scales for Primary School Students according to Gender. Journal of Scientific Research in Literature, 24(4), 1-50.
Al-Omari, Hasan; Shatnawi, Abdullah (2016). Differential Performance of the National Mathematics Test to Adjust the Quality of Education in Mathematics for the Tenth Grade according to Gender. Journal of Research - Research, 30(8), 1529-1554.
Al-Ounati, Jihad (2017). Differential Performance of Non-Verbal Intelligence Test 4-TONI according to Gender, Family Income, and Mother's Educational Level. Studies Journal, (60), 60-72.
Fathallah, Mohamed (2021). Analysis of Levels of Panic Attacks from the COVID-19 Pandemic using the Single Response Theory: A Differential Diagnostic Study on Samples from the Arab Community. Journal of the Faculty of Education in Arish, 9(27), 103-202.
Fathallah, Mohamed Mohamed (2021). Analysis of Levels of Panic Attacks from the COVID-19 Pandemic using the Single Response Theory: A Differential Diagnostic Study on Samples from the Arab Community. Journal of the Faculty of Education - Arish, 9(27), 103-202.
Al-Qawasimah, Ahmed Youssef; Al-Rahil, Rateb Sayel (2012). Effect of Item Performance on the Vertical Equation Accuracy of the Test. Journal of the Faculty of Education - Assiut University, 28(4), 53-78.
Al-Badi, Nizar (2008). Comparison of Four Methods for Detecting the Accuracy of Differential Paragraph: A Simulation Study. Doctoral Dissertation, University of Jordan.
Mubarak, Mamoun bin Mohamed Ahmed; Mubarak, Wael Mohamed Ahmed (2013). Differential Performance of Mathematics Test in the PISA 2006 International Study. Journal of Educational Sciences, King Saud University, 25(2), 241-261.
Al-Maskari, Hilal; Al-Muharzi, Rashid; Hassan, Abdul Hamid (2021). Differential Performance of Verbal Ability Test Items in the Gulf Multiple Intelligence Abilities Scale for Students of the Gulf Cooperation Council Countries according to Gender and Country. Journal of Psychological and Educational Studies, 15(1), 120-137.
Al-Wabil, Wadean (2023). Differential Performance of Items in the Tripartite Intelligence Test according to Gender and Specialization for Students at Qassim University. Journal of Literature Studies in Psychology and Education, 5(1), 59-102.
المراجع الأجنبية:
Abu Hammad, K. (2008). Investigating the effectiveness of item characteristic curve in detecting differential functioning according to gender in a selected sample from a mathematics test. Master Thesis, Yarmouk University. Jordan.
Angoff, H. (1972). A technique for the investigation of cultural differences. Paper presented at the annual meeting of the American Psychological Association, Honolulu. https://eric.ed.gov/?id=ED069686
Ayanwale, A. (2022). Performance of exploratory structural equation model (ESEM) in detecting differential item functioning. EUREKA: Social and Humanities, (1), 58-73.
Boone, J., Yale, S., & Staver, R. (2014). Rasch analysis in the human sciences. In Rasch Analysis in the Human Sciences. https://doi.org/10.1007/978-94-007-6857-4
Bormanaki, B., Ajideh, P. (2022). Item performance across native language groups on the Iranian National University Entrance English Exam: a nationwide study. Lang Test Asia, 12(29). https://doi.org/10.1186/s40468-022-00185-2
Chaimongkol, S. (2005). Modeling Differential Item Functioning (DIF) Using Multilevel Logistic Regression Models: A Bayesian Perspective. Doctoral dissertation. Florida State University.
Cock, E., Emons, W., Nefs, G., Pop, V. & Pouwer, F. (2011). Dimensionality and Scale Properties of the Edinburgh Depression Scale (EDS) in Patients with type 2 Diabetes Mellitus. BMC Psychiatry, 11(141), 1-19.
Crocker, L & Algina, J. (2008). Introduction to classical and modern test theory. Ohio: Cengage Learning.
Czachowski, S., Terluin, B., Izdebski, A. & Izdebski, P. (2012). Evaluating the Cross-cultural Validity of the Polish Version of the FourDimensional Symptom Questionnaire (4DSQ) Using Differential Item Functioning (DIF) Analysis. Family Practice, 29, 609-516.
Dorans, J., & Holland, W. (1992). DIF detection and description: Mantel‐Haenszel and standardization. ETS Research Report Series, 1992(1), 1-40.
Ellis, B. & Raju, N. (2003). Test and Item Bias: What They Are, What They Aren't, and How to Detect Them. In Janet, E. Editor & Garry, R. Editor (Eds.), Measuring Up: Assessment Issues for Teachers, Counselors, and Administrators (pp 89-98). Office of Educational Research            and      Improvement (ED),           Washington.  https://eric.ed.gov/?id=ED480042
Eteng-Uket, S. (2021). Analysis of Socio-Economic Status and Gender Related Differential Item Functioning Using Item Response Theory Approach. Asian Journal of Education and Social Studies, 16(2), 42–55.
Gonzalez, O. & Pelham W. (2021). When Does Differential Item Functioning Matter for Screening? A Method for Empirical Evaluation. Assessment; 28(2):446-456.
Guo A., Crum A., Fowler A. (2021) Assessing the psychological impacts of CoViD-19 in undergraduate medical students. Int J Environ Res Public Health, 18(6):2952 doi: 10.3390/ijerph18062952. PMID: 33805787; PMCID: PMC8001627.
Gyamfi, A. (2023).  Differential Item Functioning of Performance-Based Assessment in Mathematics for Senior High Schools. Jurnal Evaluasi dan Pembelajaran, 5 (1), 20-34
Hambleton, K., Swaminathan, H., & Rogers, J. (1991). Fundamentals of item response theory. Newbury Park, CA Sage Publications.
Hossain, M., Sultana, A. & Purohit, N. (2020). Mental health outcomes of quarantine and isolation for infection prevention: A systematic umbrella review of the global evidence. Epidemiology and Health. doi: 10.4178/epih. e2020038. Available at SSRN:
Hwanggyu, L.; Edison C.; Kyung H. (2022). A Residual-Based Differential Item Functioning Detection Framework in Item Response Theory. Journal of Educational Measurement, 59 (1), 80-
Kamata, A.  & Vaughn, B. (2004). An Introduction to Differential Item Functioning Analysis. Learning Disabilities: A Contemporary Journal, 2(2), 49-69.
Kondratek, B. & Grudniewska, M. (2014). Comparison of Mantel–Haenszel with IRTprocedures for DIF detection and effect size estimation for dichotomous items. Edukacja, 5(130), 92–111
Lopez, E., (2012). Detection and Classification of DIF Types Using Parametric and Nonparametric Methods: A comparison of the IRT-Likelihood Ratio Test, Crossing-SIBTEST, and Logistic Regression Procedures. USF Tampa Graduate Theses and Dissertations. https://digitalcommons.usf.edu/etd/4131
Mendes-Barnett, S., & Ercikan, K. (2006). Examining Sources of Gender DIF in Mathematics Assessments Using a Confirmatory Multidimensional Model Approach. Applied Measurement in Education, 19(4), 289–304.
Millsap RE, & Kwok OM (2004). Evaluating the impact of partial factorial invariance on selection in two populations. Psychological Methods, 9, 93–115.
Moyo, S. (2015). Imensionality analysis of students’ performance in 2013 BGCSE agricultural examination: implications for differential item functioning. A research essay submitted to the university in partial fulfilment for the degree of Master of Education in Research and Evaluation, Department of Educational Foundations, Faculty of Education.
Niloufar, S. (2023). Validation of a Language Center Placement Test: Differential Item Functioning. International Journal of Language Testing, 13(1), 1-17.
Oshima, T., Raju, N., Flowers, C. & Slinde, J., (1998). Differential Bundle Functioning Using the DFIT Framework: Procedures for Identifying Possible Sources of Differential Functioning. Applied Measurement in Education, 11(4), 353- 369.
Osterlind, S. J., & Everson, H. T. (2009). Differential item functioning. (2nd ed.) [Quantitative Applications in the Social Sciences: 161, Sage. https://doi.org/10.4135/ 9781412993913
Pae. T. (2004). DIF for Examinees with Different Academic Backgrounds. Language Testing, 21(1) 53-73
Park E., Ahn S., Zopluoglu C. (2021). Differential Item Functioning Effect Size from the Multigroup Confirmatory Factor Analysis for a Meta-Analysis: A Simulation Study. Educ Psychol Meas, (1):182-199.
Park, C. (2010). Differential Item Functioning Analysis of an EFL Item Test. English Teaching, 65(3), 23-41.  
Pattanaik S, John MT, Chung S, Keller S. Differential Item Functioning of the Jaw Functional Limitation Scale. J Oral Facial Pain Headache, 37(1):33-46.
Porter E., Chambless L. (2015). A systematic review of predictors and moderators of improvement in cognitive-behavioral therapy for panic disorder and agoraphobia. Clin Psychol Rev. 42,92-179.
Quittkat L., Düsing R., Holtmann F-J., Buhlmann U., Svaldi J. & Vocks S. (2020) Perceived Impact of Covid-19 Across Different Mental Disorders: A Study on Disorder-Specific Symptoms, Psychosocial Stress and Behavior. Front. Psychol. 11:586246. doi: 10.3389/fpsyg.2020.586246
Raju, S., van-der Linden, J., & Fleer, F. (1995). IRT-Based Internal Measures of Differential Functioning of Items and Tests. Applied Psychological Measurement, 19(4), 353–863.
Robillard, R., Saad, M., Edwards, J. D., Solomonova, E., Pennestri, H., Daros, A., & Kendzerska, T. (2020). Social, Financial and Psychological Stress during an Emerging Pandemic: Observations from a Population Web-Based Survey in the acute phase of the COVID-19 pandemic.  BMJ Open. doi: 10.1136/bmjopen-2020-043805. PMID: 33310814; PMCID: PMC7735085.
Runnels. J. (2013). Measuring Differential Item and Test Functioning Across Academic Disciplines. Language Test in Asia, 3(9), 1-11.
Shanmugam. K., (2020). Gender Related Differential Item Functioning of Mathematics Computation Item among None-native Speakers of English. The Mathematics Enthusiast, 17(1), 108-140.
Sizmur, S. (1997). Look back in Angoff: a cautionary tale. British Educational Research Journal, 23, pp. 3-13.
Srisurapanont M. & Kittiratanapaiboon P. & Likhitsathian S. & Kongsuk T. & Suttajit S. & Junsirimongkol B. (2012). Patterns of alcohol; dependence in Thai drinkers: a differential item functioning analysis of gender and age bias. Addictive behaviors. 37 (2012): 173- 178.
 Sunderland, M., Afzali, M., Forbes, M., Lexine Stapinski, L. & Baillie, A., (2020) Examining differential item functioning of social interaction and performance fears in people with hazardous alcohol consumption and probable alcohol dependence. Addiction Research & Theory, 28:6, 484-492.
Swander, C.  (1991). Assessing the Differential Functioning of Items and Tests of a Polytomous Employee Attitude Survey.  Unpublished master Dissertation [. Virginia University.
Takala, S. & Kaftandjieva F. (2000). Test Fairness: A DIF Analysis of an L2 Item Test. Language Testing, 17(3), 323-340.
Uiterwijk, H., & Vallen, T. (2005). Linguistic sources of item bias for second generation immigrants in Dutch tests. Language Testing, 22(2), 211-234.
World Health Organization (2023). Initial Risk Evaluation of JN.1, 19 December 2023. Revised in 27/12/2023 from chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://www.who.int/docs/default-source/coronaviruse/18122023_jn.1_ire_clean.pdf?sfvrsn=6103754a_3
Yavuz, S., Dogan, N., Hambleton, R. K. & Yurtcu, M. (2018). The Comparison of Differential Item Functioning Predicted through Experts and Statistical Techniques. Cypriot Journal of Educational Science. 13(2), 375–384.
Zhu, X. & Aryadoust, V. (2022) .An investigation of mother tongue differential item functioning in a high-stakes computerized academic reading test. Computer Assisted Language Learning, 35:3, 412-436.
Zumbo, D. (1999). A Handbook on the Theory and Methods of Differential ItemFunctioning (DIF): Logistic Regression Modeling as a Unitary Framework for Binaryand Likert-Type (Ordinal) Item Scores. Ottawa, ON: Directorate of Human ResourcesResearch and Evaluation, Department of National Defense.