Journals / Bartın Üniversitesi Eğitim Fakültesi Dergisi / 2017 / Cilt: 6 - Sayı: 2

Face Validity Study of a Small-Scale Test in a Tertiary-Level Intensive EFL Program

Üniversite İngilizce Hazırlık Sınıfında Küçük Ölçekli Bir Sınav için Görünüş Geçerliği Çalışması

Pages
395–410
Publication Date
2017-06-30
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The results revealed a moderate level of agreement between test designers and language instructors while a lower agreement percentage was obtained with test takers.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The assessment of language abilities play a crucial role in designing tests.
📊
Key Findings & Data:The study was conducted at Gaziantep University Higher School of Foreign Languages with 38 test takers, seven language instructors, and four test designers.
💡
Conclusion & Impact:The results revealed a moderate level of agreement between test designers and language instructors while a lower agreement percentage was obtained with test takers.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Kapsam geçerlik · küçük ölçekli sınavlar · uzman görüşü

Abstract

The assessment of language abilities play a crucial role in designing tests. In order to create a positive and motivating learning environment for test takers, one of the most important factors is the administration of tests with high levels of face validity as well as test taker cognizance of the abilities necessary for exam success. Therefore, this study examined the overlap in test takers’ and language instructors’ perceptions of the abilities being tested as well as test developers’ intentions in preparing exam items. The study was conducted at Gaziantep University Higher School of Foreign Languages with 38 test takers, seven language instructors, and four test designers. Data was collected by means of a response sheet on test takers’ perceptions of tests after being modified in accordance with the test to be analysed. The results revealed a moderate level of agreement between test designers and language instructors while a lower agreement percentage was obtained with test takers.

Özet

Dil becerilerinin ölçülmesi ve değerlendirilmesi eğitim öğretim çalışmaları kapsamında önemli bir alandır ve eğitim öğretim süreçlerini de şekillendiren önemli sonuçlara sahiptir. Sınava girecek öğrenciler için olumlu ve motive edici bir öğrenme ve sınav ortamı oluşturmak hem sınav görünüş geçerliği kavramının temeli hem de sınavı hazırlayanların amaçlarından bir tanesidir. Bu amaçla, bu çalışmada sınava giren öğrencilerin, sınavı hazırlayan ve derse giren öğretim elemanlarının sınavdaki maddelerin hazırlanma amaçları ile ilgili görüşleri araştırılmıştır. Bu çalışmada Gaziantep Üniversitesi Yabancı Diller Yüksekokulu İngilizce hazırlık sınıfında öğrenim gören 38 öğrenci, aynı birimden yedi öğretim elemanı ve dört sınav hazırlama komisyonu üyesi yer almıştır. Cevap kodlama formu ve bire bir görüşme yöntemleri kullanılarak nicel ve nitel veri toplanmıştır. Araştırma sonuçlarına göre sınav hazırlayanlar ile derse giren öğretim elemanlarının sınav sorularının amaçlarını eşleştirmede orta düzeyde bir uyuma sahip olduğu, öğrencilerde ise düşük seviyeli bir uyum olduğu belirlenmiştir.

🔖

Cite This Article

Cinkara, E., Tosun, Ö. Ö. (2017). Face Validity Study of a Small-Scale Test in a Tertiary-Level Intensive EFL Program. Bartın Üniversitesi Eğitim Fakültesi Dergisi, Cilt: 6 - Sayı: 2, 395–410. https://ajindex.com/articles/55448

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.
  2. Barnett, L. M., Ridgers, N. D., Zask, A., & Salmon, J. (2015). Face validity and reliability of a pictorial instrument for assessing fundamental movement skill perceived competence in young children. Journal of Science and Medicine in Sport, 18, 98-102. https://doi.org/10.1016/j.jsams.2013.12.004
  3. Brown, A. (1993). The role of test-taker feedback in the test development process: test- takers' reactions to a tape-mediated test of proficiency in spoken Japanese. Language Testing, 10, 277-303.
  4. Brown, HD, & Abeywickrama, P. (2010). Language assessment: Principles and classroom practices (2nd ed.). White Plains, NY: Pearson Education. Brown, J. D. & Hudson, T. (2002). Criterion-referenced language testing. Cambridge: Cambridge University Press.
  5. Chan, D., & Schmitt, N. (1997). Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions. Journal of Applied Psychology, 82(1), 143-159. https://doi.org/10.1037/0021-9010.82.1.143
  6. Davies, A, Brown, A, Elder, C, Hill, K, Lumley, T, & McNamara, T. (1999). Dictionary of language testing. Cambridge: Cambridge University Press.
  7. Elder, C. (2007). OET-IELTS benchmarking study report. Australia: Language Testing Research Centre, University of Melbourne. Grand, J. A., Ryan, A. M., Schmitt, N., Hmurovic, J. (2010). How Far Does Stereotype Threat Reach? The Potential Detriment of Face Validity in Cognitive Ability Testing. Human Performance, 24(1), 1-28. http://doi.org/10.1080/08959285.2010.518184
  8. He, L., & Shi, L. (2008). ESL test takers' perceptions and experiences of standardized English writing tests. Assessing Writing, 13(2), 130-149.
  9. Hill, K. (1998). The effect of test-taker characteristics on reactions to and performance on an oral English proficiency test. In A.J. Kunnan (Ed.) Validation in language assessment (pp. 299-323).
  10. Mahwah, NJ: Lawrence Erlbaum. Holden, R. R. (2010). Face Validity. The Corsini Encyclopedia of Psychology: John Wiley & Sons, Inc. Hughes, A. (2003). Testing for language teachers. Cambridge: Cambridge University Press.
  11. Kafer, K. L., & Hunter, M. (1997). On testing the face validity of planning/problemsolving tasks in a normal population. Journal of the International Neuropsychological Society, 3(2), 108-119.
  12. Kim, H., & Elder, C. (2015). Interrogating the construct of aviation English: Feedback from t