Journals / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2020 / Cilt: 11 - Sayı: 3

Analysis of Differential Item Functioning of PISA 2015 Mathematics Subtest Subject to Gender and Statistical Regions

Pages
283–301
Publication Date
2020-09-27
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Minimum DIF was observed in item Q4 as a result of regional comparisons, whereas maximum DIF was observed in items Q47 and Q50.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:It is accepted that the presence of Differential Item Functioning (DIF) in large scale examinations may be an indication of bias.
📊
Key Findings & Data:The aim of the present study was to analyze whether dichotomous (1-0) items in the PISA 2015 mathematics subtest exhibit DIF with regard to gender and statistical regions.
💡
Conclusion & Impact:Minimum DIF was observed in item Q4 as a result of regional comparisons, whereas maximum DIF was observed in items Q47 and Q50.
🔬Design:Modeling & Simulation
📍Scope:2015 Verileri
⚙️Variables:Differential item functioning · Rasch model · bias

Abstract

It is accepted that the presence of Differential Item Functioning (DIF) in large scale examinations may be an indication of bias. The aim of the present study was to analyze whether dichotomous (1-0) items in the PISA 2015 mathematics subtest exhibit DIF with regard to gender and statistical regions. The study was carried out using the data of 2409 students who took part in PISA 2015 and answered all mathematics questions. Rasch model was used via Winsteps software to determine whether the items exhibit DIF or not. Confirmatory Factor Analysis (CFA) was applied to the sixty-three mathematics questions in the clusters. The modification indices and goodness of fit values were examined for CFA and a total of eight items that disrupt the model structure were excluded from the test. DIF analyses were carried out for the 55 items that were observed to be one-dimensional. The analysis results based on gender indicated that five items exhibit DIF. Two of these items exhibit DIF in favor of girls, while three in favor of men. Statistically significant DIF findings were observed in all items when the analyses results based on statistical regional units were analyzed. While at least 10 DIF cases were observed as a result of the binary territory comparison on an item basis, maximum 38 DIF cases were observed. Minimum DIF was observed in item Q4 as a result of regional comparisons, whereas maximum DIF was observed in items Q47 and Q50.

🔖

Cite This Article

ÇELİK, M., ÖZKAN, Y. Ö. (2020). Analysis of Differential Item Functioning of PISA 2015 Mathematics Subtest Subject to Gender and Statistical Regions. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 11 - Sayı: 3, 283–301. https://ajindex.com/articles/137298

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (10)

  1. Acar, T. (2011). Sample size in differential item functioning: An application of hierarchical linear modeling. Kuram ve Uygulamada Eğitim Bilimleri, 11(1), 284-288.
  2. Akalın, Ş. (2014). Kamu Personeli Seçme Sınavı genel yetenek testinin madde yanlılığı açısından incelenmesi. (Doktora Tezi, Ankara Üniversitesi, Ankara). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi/tezSorguSonucYeni.jsp
  3. Akour, M., AL-Baddareen, G., H., A., & AL Duwairi, A. (2015). Exploring the jordanian gender gap in a large-scale assessment in mathematics. Jordan Journal of Educational Sciences, 11(1), 101-111.
  4. Ardıç, E. Ö., & Gelbal, S. (2017). Cross‐group equivalence of interest and motivation items in PISA 2012 Turkey Sample. Eurasian Journal of Educational Research, 68(2017), 221-238. doi: 10.14689/ejer.2017.68.12 Ariffin, S. R., Idrıs, R., & Ishak, N. M. (2010). Differential item functioning in Malaysian generic skills instrument (MyGSI). Journal Pendidikan Malaysia, 35(1), 1-10.
  5. Arikan, S., Van de Vijver, F. R., & Yagmur, K. (2018). Propensity score matching helps to understand sources of DIF and mathematics performance differences of Indonesian, Turkish, Australian, and Dutch students in PISA. International Journal of Research in Education an Science, 4(1), 69-82. doi: 10.21890/ijres.382936 Atalay Kabasakal, K., ve Kıbrıslıoğlu Uysal, N. (2017). Öğrenci özelliklerinin cinsiyete dayalı değişen madde fonksiyonuna etkisi. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 4(8), 373-390. doi: 10.21031/epod.333451 Ateşok Deveci, N. (2008). Üniversitelerarası kurul yabancı dil sınavının madde yanlılığı bakımından incelenmesi. (Doktora Tezi, Ankara Üniversitesi, Ankara). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi/tezSorguSonucYeni.jsp
  6. Bakan Kalaycıoğlu, D. (2008). Öğrenci Seçme Sınavı'nın madde yanlılığı açısından incelenmesi. (Doktora Tezi, Hacettepe Üniversitesi, Ankara). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi/tezSorguSonucYeni.jsp
  7. Bakan Kalaycıoğlu, D., ve Kelecioğlu, H. (2011). Öğrenci Seçme Sınavının madde yanlılığı açısından incelenmesi. Eğitim ve Bilim, 36(161), 3-13.
  8. Baykul, Y. (2000). Eğitimde ve psikolojide ölçme: Klasik Test Teorisi ve uygulanması. Ankara:
  9. ÖSYM Yayınları.
  10. Bekci, B. (2007). Ortaöğretim Kurumları Öğrenci Seçme Sınavının değişen madde fonksiyonlarının cinsiyete ve okul türüne göre incelenmesi. (Yüksek lisans Tezi, Hacettepe Üniversitesi, Ankara). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi/tezSorguSonucYeni.jsp Be