Journals / Kuram ve Uygulamada Eğitim Bilimleri / 2016 / Cilt: 16 - Sayı: 1

Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels

Pages
319–330
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

As a result of the analyses, it was concluded that a comparison of IRT- and CTT-based methods indicate a greater number of items with distinctively significant differential item functioning.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The study aims to examine whether differential item function is displayed in three different test forms that have item orders of random and sequential versions (easy-to-hard and hard-to-easy), based on Classical Test Theory (CTT) and Item Response Theory (IRT) methods and bearing item difficulty levels in mind.
📊
Key Findings & Data:In the correlational research, the data from a total of 578 seventh graders were gathered using an Atomic Structures Achievement Test.
💡
Conclusion & Impact:As a result of the analyses, it was concluded that a comparison of IRT- and CTT-based methods indicate a greater number of items with distinctively significant differential item functioning.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Abstract

The study aims to examine whether differential item function is displayed in three different test forms that have item orders of random and sequential versions (easy-to-hard and hard-to-easy), based on Classical Test Theory (CTT) and Item Response Theory (IRT) methods and bearing item difficulty levels in mind. In the correlational research, the data from a total of 578 seventh graders were gathered using an Atomic Structures Achievement Test. R programming language and "difR" package were employed for all the analyses. As a result of the analyses, it was concluded that a comparison of IRT- and CTT-based methods indicate a greater number of items with distinctively significant differential item functioning. Different item ordering leads students at the same ability levels to display different performances on the same items. As a result, it is found that item order differentiates the probability of correct response to the items for those at the same ability levels. A test form of sequential easy-to-hard questions brings more advantages than that of a hard-to-easy sequence or a random version. The findings show that it is essential to arrange tests that are employed to make decisions about people in consideration with psychometric principles.

🔖

Cite This Article

BÖKEOĞLU, Ö. Ç., GÜL, E., GÜL, Ç. D. (2016). Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels. Kuram ve Uygulamada Eğitim Bilimleri, Cilt: 16 - Sayı: 1, 319–330. https://ajindex.com/articles/274500

References (9)

  1. Angoff, W. H. (Ed.). (1993). Perspectives on differential item functioning methodology. Differential item functioning. New Jersey, NJ: Lawrence Erlbaum Associates Publishers. Ankara Üniversitesi Eğitim Bilimleri Fakültesi. (2011). Ankara Üniversitesi Eğitim Bilimleri Fakültesi'nin YGS hakkında görüşü [The view of Faculty of Education, Ankara University about the Higher Education Entrance Examination]. Retrieved from http://rigel2.cc.ankara.edu.tr/dyr.php?id=11705
  2. Balch, W. R. (1989). Item order affects performance on multiple-choice exams. Teaching of Psychology, 16(2), 75-77.
  3. Brenner, M. H. (1964). Test hardy, reliability, and discriminations of item hardy order. Journal of Applied Psychology, 48(2), 98-100.
  4. Camilli, G., & Shepard, L. A. (1994). Methods for identifying biased test items. London, UK: Sage. Carlson, J. L., & Ostrosky, A. L. (1992). Item sequence and student performance on multiple-choice exams: Further evidence. Journal of Economic Education, 2(3), 232-235.
  5. Doğan-Gül, Ç. (2014). Madde güçlüklerine göre farklı sıralanan testlerde düşük ve yüksek kaygılı öğrencilerin akademik başarıları puanlarının karşılaştırılması [A comparison of academic achievement scores of students with high and low anxiety levels in different sequence tests according to item difficulty] (Master's thesis, Ankara University, Ankara, Turkey). Retrieved from http://tez2.yok.gov.tr/
  6. Hambletton, R. K., & Swaminathan, H. (1989). Item response theory: Principles and applications. Boston, MA: Kluwer-Nijhoff Publishing. Holland, P. W., & Wainer, H. (Ed.). (1993). Differential item functioning. New Jersey, NJ: Lawrence Erlbaum Associates Publishers.
  7. Impara, J., & Foster, D. (2006) Strategies to minimize test fraud. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 91-114).
  8. Mahwah, NJ: Lawrence Erlbaum Associates. Kubiszyen, T., & Borich, G. (2013). Educational testing and measurement: Classroom application and practice. Hoboken, NJ: John Wiley & Sons, INC. Laffittee, R. G. (1984). Effects of item order on achievement test scores and students' perceptions of test hardy. Teaching of Psychology, 77(4), 212-214.
  9. Magis, D., Beland, S., & Raiche, G. (2015). Collection of methods to detect dichotomous Differential Item Functioning (DIF). Package 'difR'. Retrieved from https://cran.r-project.org/ web/packages/difR/difR.pdf Millsap, R. E., & Everson, H. T. (1993). Methodology review: Statistical approaches for assessing measurement bias. Applied Psychological Me