SavedAdd your journal

Journals / Turkish Online Journal of Distance Education / 2018 / Cilt: 19 - Sayı: 3

Automated Quality Assurance of Educational Testing

Rositsa DONEVA
Silvia GAFTANDZHIEVA
George TOTKOV
Pages
71–92
Publication Date
2018-07-18
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The software application has been put under real-time testing for quality evaluation of educational tests, included in e-learning courses from different subject areas that prove its applicability.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:This paper presents a study on known approaches for quality assurance of educational test and test items.
📊
Key Findings & Data:It allows tracking and evaluating the quality of educational tests in real time and provides the related quantitative data in different levels of generalization – in the level of a separate educational test, of educational tests of an entire course, or educational tests of a subject area.
💡
Conclusion & Impact:The software application has been put under real-time testing for quality evaluation of educational tests, included in e-learning courses from different subject areas that prove its applicability.
🔬Design:Survey & Empirical Study
📍Scope:Comprehensive Sample
⚙️Variables:Assessment quality · educational testing · automated quality assurance

Abstract

This paper presents a study on known approaches for quality assurance of educational test and test items. On its basis a comprehensive approach to the quality assurance of online educational testing is proposed to address the needs of all stakeholders (authors of online tests, teachers, students, experts, quality managers, etc.). According to the proposed approach is developed an original software application Test Quality Evaluation (TQE) for the automation of the stakeholders’ activities for quality assurance of educational tests throughout the whole lifecycle. The application retrieves and provides analysis of data from online tests conducted and specially designed surveys for quality evaluation of educational tests by students and experts. It allows tracking and evaluating the quality of educational tests in real time and provides the related quantitative data in different levels of generalization – in the level of a separate educational test, of educational tests of an entire course, or educational tests of a subject area. The software application has been put under real-time testing for quality evaluation of educational tests, included in e-learning courses from different subject areas that prove its applicability.

🔖

Cite This Article

DONEVA, R., GAFTANDZHIEVA, S., TOTKOV, G. (2018). Automated Quality Assurance of Educational Testing. Turkish Online Journal of Distance Education, Cilt: 19 - Sayı: 3, 71–92. https://ajindex.com/articles/139925

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (9)

  1. Amouei, A., Barari, R., Naghipour D., Mortazavi Y., & Hosseini S. Reza (2014). Evaluation of Multiple Choice Questions Quality Trend as Structure and Taxonomy. FUTURE of MEDICAL EDUCATION JOURNAL, 4(3), 26-30.
  2. APA (2014). The Standards for Educational and Psychological Testing, Retrieved July 2, 2017, from http://www.apa.org/science/programs/testing/standards aspx#overview Blackboard Help (2017).
  3. Running Item Analysis on a Test, Retrieved July 2, 2017, from https://en-us.help.blackboard.com
  4. CDC (2017). Checklist to Evaluate the Quality of Questions, Retrieved April 12, 2017, from http://www.cdc.gov/healthyyouth/ evaluation/ index.htm CFATIQC (2017). Common Formative Assessment Test Item Quality Checklist, Retrieved July 2, 2017, from https://docs.google.com/document/preview?hgd=1&id= 1vmkf0UAU21u8bGRRwtFb__4kw6NThEDM8WD9NyMgSFU&pli=1 CITL. (2017). Improving Your Test Questions. Retrieved July 2, 2017, from http://cte.illinois.edu/testing/exam/test_ques3.html 91 Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (ed.). Educational Measurement, 2nd ed., 443–507.
  5. Washington, D.C.: American Council on Education. Dill, D. D. (2010). “Quality Assurance in Higher Education: Practices and Issues.” In P. P. Peterson, E. Baker, and B. McGaw, (eds.). International Encyclopedia of Education. Third Edition. 377-383.
  6. Doneva, R., & Gaftandzhieva, S. (2015). Automated e-learning quality evaluation. Proceedings of the International Conference on e-Learning. Berlin, Germany. ISSN 2376-6698, 156-162.
  7. EFPA (2013). Revised EFPA Review Model for the Description and Evaluation of Psychological and Educational Tests, Test Review Model Version 4.2.6, Retrieved July 2, 2017, from http://www.efpa.eu/download/650d0d4ecd407a51139ca44ee704fda4
  8. EUSHARE (2015). European Standards and Guidelines for Quality Assurance in the EHEA. Belgium: EUSHARE. Gaftandzhieva S. (2016). Automated Evaluation of Students’ Satisfaction, International Journal of Information Technologies and Security (IJITS), 8(1), 31-40.
  9. Gaftandzhieva S. (2017). A Model and System for Dynamic Quality Evaluation in Higher Education. (Doctoral dissertation). Available from University of Plovdiv. Gierl, M.J., & Hollis, L. (2013). Evaluating the quality of medical multiple-choice items created with automated processes, Medical Education 2013, 47(7), 726–733, doi: 10.1111/medu.12202. Hambleton, RK, Swaminathan, H, Rogers, HJ (1991). Fundamentals of items response theory. Newbury Park (California): Sage Publications. 174