Dergiler / International Journal of Assessment Tools in Education / 2023 / Cilt: 10 Sayı: 2

Automatic item generation for online measurement and evaluation: Turkish literature items

Sayfa
218–231
Yayın Tarihi
2023-06-26
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions.
📊
Temel Bulgular & Veri:A large pool of items is required for computer-based testing applications that provide significant advantages to practitioners and test takers.
💡
Sonuç & Katkı:As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.
🔬Tür:Laboratuvar & Saha Deneyi
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Automatic item generation · Large item pool · Computer-based testing

Özet

Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions. In our country, research on the application of measurement and evaluation tools in the computer environment for use with distance education is gaining momentum. A large pool of items is required for computer-based testing applications that provide significant advantages to practitioners and test takers. Preparing a large pool of items also requires more effort in terms of time, effort, and cost. To overcome this problem, automatic item generation has been widely used by bringing together item development subject matter experts and computer technology. In the present research, the steps for implementing automatic item generation are explained through an example. In the research, which was based on the fundamental research method, first a total of 2560 items were generated using computer technology and SMEs in field of Turkish literature. In the second stage, 60 randomly selected items were examined. As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.

Abstract

Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions. In our country, research on the application of measurement and evaluation tools in the computer environment for use with distance education is gaining momentum. A large pool of items is required for computer-based testing applications that provide significant advantages to practitioners and test takers. Preparing a large pool of items also requires more effort in terms of time, effort, and cost. To overcome this problem, automatic item generation has been widely used by bringing together item development subject matter experts and computer technology. In the present research, the steps for implementing automatic item generation are explained through an example. In the research, which was based on the fundamental research method, first a total of 2560 items were generated using computer technology and SMEs in field of Turkish literature. In the second stage, 60 randomly selected items were examined. As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.

🔖

Bu Makaleye Atıf Yap

SAYIN, A., GIERL, M. J. (2023). Automatic item generation for online measurement and evaluation: Turkish literature items. International Journal of Assessment Tools in Education, Cilt: 10 Sayı: 2, 218–231. https://ajindex.com/articles/951354

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (12)

  1. Adıgüzel, A. (2020). Teachers’ views on distance education and evaluation of student success in the pandemic process. Milli Eğitim Dergisi, 49(1), 253 271. https://doi.org/10.37669/milliegitim.781998
  2. Alves, C.B., Gierl, M.J., & Lai, H. (2010). Using automated item generation to promote principled test design and development. American Educational Research Association, Denver, CO, USA. Arendasy, M.E., & Sommer, M. (2012). Using automatic item generation to meet the increasing item demands of high-stakes educational and occupational assessment. Learning and individual differences, 22(1), 112-117.
  3. Artırma, F., & Hareketi, T.İ. (2020). FATİH projesi. Retrieved from: http://fatihprojesi.meb.gov.tr
  4. ASGOIG. (2022). Automatic item generation software. https://asgoig.com/
  5. Bai, Y. (2019). Cognitive Diagnostic Models-based Automatic Item Generation: Item Feature Exploration and Calibration Model Selection. Columbia University. Balta, Y., & Türel, Y. (2013). An examination on various measurement and evaluation methods used in online distance education. Turkish Studies-International Periodical For The Languages, Literature and History of Turkish or Turkic, 8(3), 37-45. http://dx.doi.org/10.7827/TurkishStudies.427
  6. Bayardo, R.J., Ma, Y., & Srikant, R. (2007). Scaling up all pairs similarity search. Proceedings of the 16th international conference on World Wide Web. Bennett, R.E. (2011). Formative assessment: A critical review. Assessment in education: principles, policy & practice, 18(1), 5-25.
  7. Chen, B., Zilles, C., West, M., & Bretl, T. (2019). Effect of discrete and continuous parameter variation on difficulty in automatic item generation. Artificial Intelligence in Education: 20th International Conference, AIED 2019,
  8. Chicago, IL, USA, June 25-29,
  9. Proceedings, Part I 20, Choi, J., Kim, H., & Pak, S. (2018). Evaluation of Automatic Item Generation Utilities in Formative Assessment Application for Korean High School Students. Journal of Educational Issues, 4(1), 68-89.
  10. Choi, J., & Zhang, X. (2019). Computerized item modeling practices using computer adaptive formative assessment automatic item generation system: A tutorial. The Quantitative Methods for Psychology, 15(3), 214-225.
  11. Clark, C.M., & Rust, F.O.C. (2006). Learning-centered assessment in teacher education. Studies in Educational Evaluation, 32(1), 73-82.
  12. Colvin, K.F. (2014). Effect of automatic item generation on ability estimates in a multistage test. University of Massachusetts Amherst. Corbett, A.T., & Anderso