Dergiler / Eurasian Journal of Educational Research / 2018 / Cilt: 74 - Sayı: 74

Investigating the Performance of Omega Index According to Item Parameters and Ability Levels

Sayfa
207–226
Yayın Tarihi
2022-10-18
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

Implications for Researchand Practice: The study suggests that researchers must pay attention to copiers - source abilitylevel and copied items' difficulty levels while using ω index for detecting answer copying.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:Purpose: Several studies can be found in theliterature that investigate the performance of ω undervarious conditions.
📊
Temel Bulgular & Veri:However no study for the effects of item difficulty, item discrimination, and ability restrictions on the performance of ω could be found.
💡
Sonuç & Katkı:Implications for Researchand Practice: The study suggests that researchers must pay attention to copiers - source abilitylevel and copied items' difficulty levels while using ω index for detecting answer copying.
🔬Tür:Araştırma Makalesi
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Alan Parametreleri

Abstract

Purpose: Several studies can be found in theliterature that investigate the performance of ω undervarious conditions. However no study for the effects of item difficulty, item discrimination, and ability restrictions on the performance of ω could be found. The current study aims to investigate the performance of ω for the conditions given below. Research Methods: b parameter range was restricted in two levels (-2.50 – 0.00, 0.01 – 2.50); a parameterrange, in two levels (0.10 – 0.80 and 0.81 – 1.50). Aftercrossing a and b parameter ranges, four differentitem parameter cells were obtained. 10,000 examinee responses were generated for each itemparameter cell for 20 items. After combining four data sets, an 80-itemdataset was obtained.In order to obtain the effects of source’s and copier’s ability levels to the performance of ω,ability range was divided into four intervals (-3.00 – -1.50, -1.50 – 0.00, 0.00 – 1.50 and 1.50 –3.00). By crossing the ability ranges of source and copier, sixteen different combinations wereobtained. Each of the sixteen ability pairs of source and copier cheating was investigated foritem parameter crossing cells for power study of ω. For Type I error study, no cheating datawere investigated for the same conditions and levels. Findings: Type I error inflations wereobserved for the lower copier ability levels. The results of the power study indicate that whenhigh ability level copier copied answers of the low difficulty level and high discriminativeitems from high ability level source, power of ω was weakened. Implications for Researchand Practice: The study suggests that researchers must pay attention to copiers - source abilitylevel and copied items' difficulty levels while using ω index for detecting answer copying.

🔖

Bu Makaleye Atıf Yap

YORMAZ, S., SÜNBÜL, Ö. (2022). Investigating the Performance of Omega Index According to Item Parameters and Ability Levels. Eurasian Journal of Educational Research, Cilt: 74 - Sayı: 74, 207–226. https://ajindex.com/articles/507147

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (11)

  1. Angoff, W.H. (1974). The development of statistical indices for detecting cheaters. Journal of American Statistical Association, 69, 44-49.
  2. Anikeef, A.M. (1954). Index of collaboration for test administrators. Journal of Applied Psychology, 38, 174-177.
  3. Armstrong, R. D., & Shi, M. (2009). A parametric cumulative sum statistic for person fit. Applied Psychological Measurement, 33(5), 391-410.
  4. Assessment Systems Corporation (1993). Scrutiny!: Software to identify test misconduct. Advanced Psychometrics. Bay, M. L. G. (1994). Detection of copying on multiple-choice examinations (Doctoral dissertation, Southern Illinois University, 1987). Dissertation Abstracts International, 56(3-A), 899. Bellezza, F.S., & Bellezza, S.F. (1989). Detection of cheating on multiple-choice tests by using error-similarity analysis. Teaching of Psychology, 16, 151-155. British Journal of Arts and Social Sciences ISSN: 2046-9578 59. Belov, D. I. (2011). Detection of answer copying based on the structure of a high-stakes test. Applied Psychological Measurement, 35(7), 495–517.
  5. Belov, D. I., & Armstrong, R. D. (2010). Automatic detection of answer copying via kullback-leibler divergence and K-index. Applied Psychological Measurement, 34(6), 379–392.
  6. Bird, C. (1927). The detection of cheating in objective examinations. School and society, 25, 261-262.
  7. Bird, C. (1929). An improved method of detection cheating in objective examinations. Journal of Educational Research, 25, 261-262.
  8. Cizek, G. J., & Wollack, J. A. (2017). Handbook of quantitative methods for detecting cheating on tests. New York, NY: Routledge. Clark, J. M. (2010). Aberrant response patterns as a multidimensional phenomenon: Using factor-analytic model comparison to detect cheating. ProQuest LLC. University of Kansas. Deng, W. (2008). An innovative use of the standardized log-likelihood statistic to evaluate person fit. Dissertation Abstracts International Section A: Humanities and Social Sciences. Rutgers State University of New Jersey. Frary, R. B. (1993). Statistical detection of multiple-choice answer copying: Review and commentary. Applied Measurement in Education, 6, 153-65.
  9. Frary, R. B., Tideman, T. N., & Watts, T. M. (1977). Indices of cheating on multiple- choice tests. Journal of Educational Statistics, 6, 152-165.
  10. Hanson, B. A., Harris, D. J., & Brennan, R. L. (1987). A comparison of several statistical methods for examining allegations of copying (ACT Research Report Series No. 87-15).
  11. Iowa City, IA: American C