KaydedilenlerDerginizi ekleyin

Dergiler / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2019 / Cilt: 10 - Sayı: 3

An Example of Empirical and Model Based Methods for Performance Descriptors: English Proficiency Test

Serkan ARIKAN
Eda ÜSTÜNEL
Sevilay KİLMEN
Mehmet ABİ
Sayfa
219–234
Yayın Tarihi
2022-10-12
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

Using these performance level descriptors, it is possible to give criterion referenced feedback to each student about his/her reading abilities.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:Great emphasis is given to the development of high-stake tests all around the world and in Turkey.
📊
Temel Bulgular & Veri:Too much emphasis on rankings and almost no emphasis on performance level descriptors (meaning of the scores) have leaded a “ranking culture” in Turkey.
💡
Sonuç & Katkı:Using these performance level descriptors, it is possible to give criterion referenced feedback to each student about his/her reading abilities.
🔬Tür:Modelleme & Sayısal Simülasyon
📍Kapsam:2016-2017 Verileri
⚙️Değişkenler:Alan Parametreleri

Abstract

Great emphasis is given to the development of high-stake tests all around the world and in Turkey. However, limited emphasis is given to adequate score reporting. Too much emphasis on rankings and almost no emphasis on performance level descriptors (meaning of the scores) have leaded a “ranking culture” in Turkey. There is an immense need to raise awareness about score reporting and performance level descriptions in Turkey. This study aims to raise awareness about the use of performance level descriptors in a high-stake exam in Turkey, an English proficiency exam. The study sample is consisted of 630 undergraduate students who took the 2016-2017 English proficiency exam of a public university in the southwest of the Turkey. In order to identify the potential exemplars, two types of item mapping methods (i.e. experimental based method and model-based method) were used in the present study. Item grouping for performance level descriptors provided hierarchical and interpretable structure. Using these performance level descriptors, it is possible to give criterion referenced feedback to each student about his/her reading abilities.

🔖

Bu Makaleye Atıf Yap

ARIKAN, S., ÜSTÜNEL, E., KİLMEN, S., ABİ, M. (2022). An Example of Empirical and Model Based Methods for Performance Descriptors: English Proficiency Test. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 10 - Sayı: 3, 219–234. https://ajindex.com/articles/497210

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (6)

  1. Arıkan, S., & Kilmen, S. (2018). Sınıf içi ölçme ve değerlendirmede puanlara anlam kazandırma: %70 doğru yanıt yöntemi. İlköğretim Online, 17(2), 888-908. doi: 10.17051/ilkonline.2018.419337 Beaton, A. E., & Allen, N. L. (1992). Interpreting scales through scale anchoring. Journal of Educational Statistics, 17(2), 191-204. doi: 10.3102/10769986017002191 Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 137–162).
  2. Newbury Park, CA: Sage. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. doi: 10.1207/S15328007SEM0902_5 Demirtaşlı, N. (2009). Eğitimde niteliği sağlamak: Ölçme ve değerlendirme sistemi örneği olarak CİTO Türkiye öğrenci izleme sistemi (ÖİS). Cito Eğitim: Kuram ve Uygulama, 3, 25-38.
  3. Draney, K., & Wilson, M. (2009). Selecting cut scores with a composite of item types: The Construct Mapping procedure. In E. V. Smith Jr. & G. E. Stone (Eds.), Criterion referenced testing: Practice analysis to score reporting using Rasch measurement models (pp. 276–293).
  4. Maple Grove, MN: JAM Press.
  5. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. London: Lawrence Elbaum Associates, Publishers.
  6. George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed.). Boston: Allyn & Bacon. Goodman, D. P., & Hambleton, R. K. (2004). Student test score reports and interpretive guides: Review of current practices and suggestions for future research. Applied Measurement in Education, 17(2), 145-220. doi: 10.1207/s15324818ame1702_3 Hambleton, R. K., & Jones, R. W. (1993). Comparison of classical test theory and item response theory and their applications to test development. Educational Measurement: Issues and Practice, 12(3), 38-47. doi: 10.1111/j.1745-3992.1993.tb00543.x Hambleton, R. K., Swaminathan, H., & Rogers, H. (1991). Fundamentals of item response theory. Newbury Park CA: Sage. Hu, L.-T. & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. doi: 10.1080/10705519909540118 Huynh, H. (2006). A clarification on the response probability criterion RP67 for standard settings based on bookmark and item mapping. Educational Measurement: I