SavedAdd your journal

Journals / Journal of Language and Linguistic Studies / 2018 / Cilt: 14 - Sayı: 1

Computer-based and paper-based testing: Does the test administration mode influence the reliability and validity of achievement tests?

Bilgisayar destekli testler ve klasik testler: Test uygulama yöntemi başarı sınavlarının güvenirliğini ve geçerliliğini etkiler mi?

Hüseyin ÖZ
Tuba ÖZTURAN
Pages
67–85
Publication Date
2022-10-19
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Findings were discussed in terms of theidea that computer technology could be integrated into the curriculum not only for instructional practices butalso for assessment purposes.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:This article reports the findings of a study that sought to investigate whether computer-based vs. paper-basedtest-delivery mode has an impact on the reliability and validity of an achievement test for a pedagogical contentknowledge course in an English teacher education program.
📊
Key Findings & Data:A total of 97 university students enrolled in theEnglish as a foreign language (EFL) teacher education program were randomly assigned to the experimentalgroup that took the computer-based achievement test online and the control group that took the same test inpaper-and-pencil based format.
💡
Conclusion & Impact:Findings were discussed in terms of theidea that computer technology could be integrated into the curriculum not only for instructional practices butalso for assessment purposes.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Abstract

This article reports the findings of a study that sought to investigate whether computer-based vs. paper-basedtest-delivery mode has an impact on the reliability and validity of an achievement test for a pedagogical contentknowledge course in an English teacher education program. A total of 97 university students enrolled in theEnglish as a foreign language (EFL) teacher education program were randomly assigned to the experimentalgroup that took the computer-based achievement test online and the control group that took the same test inpaper-and-pencil based format. Results of Spearman Rank order and Mann-Whitney U tests indicated that testdeliverymode did not have any impact on the reliability and validity of the tests administered in either way.Findings also demonstrated that there was not any significant difference in test scores between participants whotook the computer-based test and those who took the paper-based test. Findings were discussed in terms of theidea that computer technology could be integrated into the curriculum not only for instructional practices butalso for assessment purposes.

Özet

Bu çalışma sınavların uygulanma yönteminin, ölçme-değerlendirmenin temel unsurları olan geçerlilik ve güvenirlik üzerinde etkisini araştırmayı amaçlamaktadır. Bu bağlamda Türkiye’de bulunan bir devlet üniversitesinde İngiliz dili eğitimi bölümünde okumakta olan 97 öğretmen adayı çalışmaya katılmıştır. Bütün katılımcılar İngiliz Dili Eğitimi Yöntemleri dersine kayıtlı olan öğrencilerdir. Katılımcılar deney grubu ve kontrol grubu olarak ikiye ayrılmıştır. Deney grubunda olan katılımcılar sınava bilgisayar ortamında katılırken kontrol grubunda olan katılımcılar klasik yöntemle sınava girmiştir. Çalışma sonunda sınavların bilgisayar ortamında ya da klasik yöntemle verilmesinin, güvenirlik ve geçerlilik üzerinde etkisi olmadığı göstermiştir. Ayrıca, öğrencilerin bilgisayar ortamında sınava katılmaları başarı puanlarını etkilememiştir. Sonuç olarak, bilgisayar desteği sadece eğitim süresince değil ölçme-değerlendirme aşamasında da kullanılabilir.

🔖

Cite This Article

ÖZ, H., ÖZTURAN, T. (2022). Computer-based and paper-based testing: Does the test administration mode influence the reliability and validity of achievement tests?. Journal of Language and Linguistic Studies, Cilt: 14 - Sayı: 1, 67–85. https://ajindex.com/articles/564031

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (10)

  1. Akdemir, O., & Oğuz, A. (2008). Computer-based testing: An alternative for the assessment of Turkish undergraduate students. Computers & Education, 51, 1198-1204. doi:10.1016/j.compedu.2007.11.007 Alderson, J.C. (2000). Technology in testing: The present and the future. System, 28, 53-603. doi.org/10.1016/S0346-251X(00)00040-3
  2. Al-Amri, S. (2008). Computer-based testing vs. paper-based testing: A comprehensive approach to examining the comparability of testing modes. Essex Graduate Student Papers in Language and Linguistics, 10, 22–44.
  3. American Psychological Association (1986). Guidelines for computer-based tests and interpretations. Washington, DC: Author. Bennett, R. E. (2003). Online assessment and the comparability of score meaning. Princeton, NJ: Educational Testing Service. Blerkom, M. L. V. (2009). Measurement and statistics for teachers. New York, NY: Routledge. Boo, J. (1997) Computerized versus paper-and-pencil assessment of educational development: Score comparability and examinee preferences. Unpublished PhD dissertation, University of Iowa. Brown, H.D. (2004). Language assessment: Principles and classroom practices. White Plains, NY: Pearson Education. Brown, H. D., & Abeywickrama, P. (2010). Language assessment: Principles and classroom practices.White Plains, NY: Pearson Education. Brusilovsky, P., & Miller, P. (1999). Web-based testing for distance education. Webnet 99 World conference on the WWW, Hawaii, USA, 24-30 October 1999.
  4. Bugbee, A. C. (1996). The equivalence of paper-and-pencil and computer-based testing. Journal of Research on Computing in Education, 28 (3), 282-299.
  5. Chapelle, C. (1998) Construct definition and validity inquiry in SLA research. In L. F. Bachman and A. D. Cohen (Eds.), Interfaces between second language acquisition and language testing research (pp. 32-70).
  6. New York, NY: Cambridge University Press.
  7. Chapelle, C. (1999). Validity in language assessment. Annual Review of Applied Linguistics, 19, 254-72. https://doi.org/10.1017/S0267190599190135
  8. Chapelle, C. (2001) Computer applications in second language acquisition: Foundations for teaching, testing, and research. Cambridge, England: Cambridge University Press.
  9. Chapelle, C., & Douglas, D. (2006). Assessing language through computer technology. Cambridge, England: Cambridge University Press.
  10. Chin, C. H. L. (1990). The effect of computer-based tests on the achievement, anxiety and attitudes of grade 10 science students. (Unpublised master’s thesis). The University of Br