Journals / International Journal of Assessment Tools in Education / 2023 / Cilt: 10 Sayı: 2

Automatic item generation for online measurement and evaluation: Turkish literature items

Pages
218–231
Publication Date
2023-06-26
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions.
📊
Key Findings & Data:A large pool of items is required for computer-based testing applications that provide significant advantages to practitioners and test takers.
💡
Conclusion & Impact:As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.
🔬Design:Lab & Field Experiment
📍Scope:Comprehensive Sample
⚙️Variables:Automatic item generation · Large item pool · Computer-based testing

Abstract

Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions. In our country, research on the application of measurement and evaluation tools in the computer environment for use with distance education is gaining momentum. A large pool of items is required for computer-based testing applications that provide significant advantages to practitioners and test takers. Preparing a large pool of items also requires more effort in terms of time, effort, and cost. To overcome this problem, automatic item generation has been widely used by bringing together item development subject matter experts and computer technology. In the present research, the steps for implementing automatic item generation are explained through an example. In the research, which was based on the fundamental research method, first a total of 2560 items were generated using computer technology and SMEs in field of Turkish literature. In the second stage, 60 randomly selected items were examined. As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.

Özet

Developments in the field of education have significantly affected test development processes, and computer-based test applications have been started in many institutions. In our country, research on the application of measurement and evaluation tools in the computer environment for use with distance education is gaining momentum. A large pool of items is required for computer-based testing applications that provide significant advantages to practitioners and test takers. Preparing a large pool of items also requires more effort in terms of time, effort, and cost. To overcome this problem, automatic item generation has been widely used by bringing together item development subject matter experts and computer technology. In the present research, the steps for implementing automatic item generation are explained through an example. In the research, which was based on the fundamental research method, first a total of 2560 items were generated using computer technology and SMEs in field of Turkish literature. In the second stage, 60 randomly selected items were examined. As a result of the research, it was determined that a large item pool could be created to be used in online measurement and evaluation applications using automatic item generation.

🔖

Cite This Article

SAYIN, A., GIERL, M. J. (2023). Automatic item generation for online measurement and evaluation: Turkish literature items. International Journal of Assessment Tools in Education, Cilt: 10 Sayı: 2, 218–231. https://ajindex.com/articles/951354

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. Adıgüzel, A. (2020). Teachers’ views on distance education and evaluation of student success in the pandemic process. Milli Eğitim Dergisi, 49(1), 253 271. https://doi.org/10.37669/milliegitim.781998
  2. Alves, C.B., Gierl, M.J., & Lai, H. (2010). Using automated item generation to promote principled test design and development. American Educational Research Association, Denver, CO, USA. Arendasy, M.E., & Sommer, M. (2012). Using automatic item generation to meet the increasing item demands of high-stakes educational and occupational assessment. Learning and individual differences, 22(1), 112-117.
  3. Artırma, F., & Hareketi, T.İ. (2020). FATİH projesi. Retrieved from: http://fatihprojesi.meb.gov.tr
  4. ASGOIG. (2022). Automatic item generation software. https://asgoig.com/
  5. Bai, Y. (2019). Cognitive Diagnostic Models-based Automatic Item Generation: Item Feature Exploration and Calibration Model Selection. Columbia University. Balta, Y., & Türel, Y. (2013). An examination on various measurement and evaluation methods used in online distance education. Turkish Studies-International Periodical For The Languages, Literature and History of Turkish or Turkic, 8(3), 37-45. http://dx.doi.org/10.7827/TurkishStudies.427
  6. Bayardo, R.J., Ma, Y., & Srikant, R. (2007). Scaling up all pairs similarity search. Proceedings of the 16th international conference on World Wide Web. Bennett, R.E. (2011). Formative assessment: A critical review. Assessment in education: principles, policy & practice, 18(1), 5-25.
  7. Chen, B., Zilles, C., West, M., & Bretl, T. (2019). Effect of discrete and continuous parameter variation on difficulty in automatic item generation. Artificial Intelligence in Education: 20th International Conference, AIED 2019,
  8. Chicago, IL, USA, June 25-29,
  9. Proceedings, Part I 20, Choi, J., Kim, H., & Pak, S. (2018). Evaluation of Automatic Item Generation Utilities in Formative Assessment Application for Korean High School Students. Journal of Educational Issues, 4(1), 68-89.
  10. Choi, J., & Zhang, X. (2019). Computerized item modeling practices using computer adaptive formative assessment automatic item generation system: A tutorial. The Quantitative Methods for Psychology, 15(3), 214-225.
  11. Clark, C.M., & Rust, F.O.C. (2006). Learning-centered assessment in teacher education. Studies in Educational Evaluation, 32(1), 73-82.
  12. Colvin, K.F. (2014). Effect of automatic item generation on ability estimates in a multistage test. University of Massachusetts Amherst. Corbett, A.T., & Anderso