Dergiler / International Journal of Assessment Tools in Education / 2021 / Cilt: 8 - Sayı: 1

Kirkpatrick Model: Its Limitations as Used in Higher Education Evaluation

Sayfa
135–144
Yayın Tarihi
2022-10-18
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

These suggestions to address the limitations of the model are discussed at the end of the study.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:One of the widely known evaluation models adapted to education is the Kirkpatrick model.
📊
Temel Bulgular & Veri:However, this model has limitations when used by evaluators especially in the complex environment of higher education.
💡
Sonuç & Katkı:These suggestions to address the limitations of the model are discussed at the end of the study.
🔬Tür:Literatür & Derleme Çalışması
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Kirkpatrick model · Program evaluation · Higher education

Özet

One of the widely known evaluation models adapted to education is the Kirkpatrick model. However, this model has limitations when used by evaluators especially in the complex environment of higher education. Addressing the scarcity of a collective effort on discussing these limitations, this review paper aims to present a descriptive analysis of the limitations of the Kirkpatrick evaluation model in the higher education field. Three themes of limitations were found out: propensity towards the use of the lower levels of the model; rigidity wich leaves out other essential aspects of the evaluand; and paucity of evidence on the causal chains among the levels. It is suggested that, when employing the Kirkpatrick model in higher education, evaluators should address these limitations by considering more appropriate methods, integrating contextual inputs in the evaluation framework, and establishing causal relationships among the levels. These suggestions to address the limitations of the model are discussed at the end of the study.

Abstract

One of the widely known evaluation models adapted to education is the Kirkpatrick model. However, this model has limitations when used by evaluators especially in the complex environment of higher education. Addressing the scarcity of a collective effort on discussing these limitations, this review paper aims to present a descriptive analysis of the limitations of the Kirkpatrick evaluation model in the higher education field. Three themes of limitations were found out: propensity towards the use of the lower levels of the model; rigidity wich leaves out other essential aspects of the evaluand; and paucity of evidence on the causal chains among the levels. It is suggested that, when employing the Kirkpatrick model in higher education, evaluators should address these limitations by considering more appropriate methods, integrating contextual inputs in the evaluation framework, and establishing causal relationships among the levels. These suggestions to address the limitations of the model are discussed at the end of the study.

🔖

Bu Makaleye Atıf Yap

Cahapay, M. B. (2022). Kirkpatrick Model: Its Limitations as Used in Higher Education Evaluation. International Journal of Assessment Tools in Education, Cilt: 8 - Sayı: 1, 135–144. https://ajindex.com/articles/540085

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (12)

  1. Abdulghani, H., A Al Drees, A.M., Khamis, N., & Irshad, M. (2014). Research methodology workshops evaluation using the Kirkpatrick’s model: Translating theory into practice. Medical Teacher, 36(1), s24-s29. https://doi.org/10.3109/0142159x.2014.886012
  2. Abernathy D.J. (1999). Thinking outside the evaluation box. Training Development, 53(2), 18-23. Retrieved from https://eric.ed.gov/?id=EJ578905
  3. Alliger, G., and E. Janak. Kirkpatrick’s Levels of Training Criteria: Thirty Years Later. Personnel Psychology 42(2), 331 341. https://doi.org/10.1111/j.1744-6570.1989.tb00661.x
  4. Arthur, W., Jr., Bennet, W., Edens, P.S., & Bell, S.T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88(2), 234-245. http://dx.doi.org/10.1080/0144341032000060110
  5. Arthur, W., Jr., Tubre, T. C., Paul, D. S., & Edens, P. S. (2003). Teaching effectiveness: The relation- ship between reaction and learning criteria. Educational Psychology, 23(3), 275-285. https://doi.org/10.1080/0144341032000060110
  6. Aryadoust, V. (2017). Adapting Levels 1 and 2 of Kirkpatrick’s model of training evaluation to examine the effectiveness of a tertiary-level writing course. Pedagogies: An International Journal, 12(2), 151-179. https://doi.org/10.1080/1554480X.2016.1242426
  7. Bates, R. (2004). A critical analysis of evaluation practice: the Kirkpatrick Model and the principle of beneficence. Evaluation and Program Planning, 27, 341 347. https://doi.org/10.1016/j.evalprogplan.2004.04.011
  8. Baskin, C. (2001, December). Using Kirkpatrick’s four-level-evaluation model to explore the effectiveness of collaborative online group work. In Proceedings of the Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (pp. 37-44).
  9. Melbourne, Australia: Biomedical Multimedia Unit, The University of Melbourne. Bowen, G. A. (2009) Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27-40. https://doi.org/10.3316/qrj0902027
  10. Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa
  11. Chang, N. & Chen, L. (2014). Evaluating the learning effectiveness of an online information literacy class based on the Kirkpatrick framework. Libri, 64(3), 211 223. https://doi.org/10.1515/libri-2014-0016
  12. Covington, J.A. (2012). Efficacy of webinar training for continuing professional education: applicat