Journals / International Journal of Assessment Tools in Education / 2020 / Cilt: 7 - Sayı: 2

The Development of a Scale to Evaluate Foreign Language Skills at Preparatory Schools

Pages
223–235
Publication Date
2022-10-19
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The FLSS is expected to offer a comprehensive evaluation of the acquisition of four language skills in foreign language teaching programs.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The aim of the present study is to develop a valid and reliable scale evaluating the effectiveness of language preparatory programs in the acquisition of language skills.
📊
Key Findings & Data:In the development of Foreign Language Skills Scale (FLSS) in this study, research sample consisted of 326 preparatory school students for the exploratory factor analysis (EFA) and 350 preparatory school students for the confirmatory factor analysis (CFA).
💡
Conclusion & Impact:The FLSS is expected to offer a comprehensive evaluation of the acquisition of four language skills in foreign language teaching programs.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Scale development · English language teaching · Teaching language skills

Abstract

The aim of the present study is to develop a valid and reliable scale evaluating the effectiveness of language preparatory programs in the acquisition of language skills. In the development of Foreign Language Skills Scale (FLSS) in this study, research sample consisted of 326 preparatory school students for the exploratory factor analysis (EFA) and 350 preparatory school students for the confirmatory factor analysis (CFA). Based on the data obtained from the first sample, an EFA was carried out on the FLSS. EFA has identified that 27 items of the scale have factor loads between 0.519 and 0.729, while they explain 65.376% of the total variance and are distributed under five factors. These factors are named as writing skill, speaking skill, listening skill, core skills, and reading skill. A CFA was applied on the data obtained from the second sample that consisted of 350 students. As a result of the CFA, it was confirmed that the FLSS consisted of 27 items and five factors. For all the items in the scale, item-subscale, item-test correlation coefficients and mean differences between the upper and the lower 27% of the participants were calculated, and it is determined that each item is consistent with not only the subscale it is under but also the whole test. In addition, the Cronbach’s Alpha reliability coefficients of the total scale’s and five sub-scales’ internal consistency is quite high. The FLSS is expected to offer a comprehensive evaluation of the acquisition of four language skills in foreign language teaching programs.

Özet

The aim of the present study is to develop a valid and reliable scale evaluating the effectiveness of language preparatory programs in the acquisition of language skills. In the development of Foreign Language Skills Scale (FLSS) in this study, research sample consisted of 326 preparatory school students for the exploratory factor analysis (EFA) and 350 preparatory school students for the confirmatory factor analysis (CFA). Based on the data obtained from the first sample, an EFA was carried out on the FLSS. EFA has identified that 27 items of the scale have factor loads between 0.519 and 0.729, while they explain 65.376% of the total variance and are distributed under five factors. These factors are named as writing skill, speaking skill, listening skill, core skills, and reading skill. A CFA was applied on the data obtained from the second sample that consisted of 350 students. As a result of the CFA, it was confirmed that the FLSS consisted of 27 items and five factors. For all the items in the scale, item-subscale, item-test correlation coefficients and mean differences between the upper and the lower 27% of the participants were calculated, and it is determined that each item is consistent with not only the subscale it is under but also the whole test. In addition, the Cronbach’s Alpha reliability coefficients of the total scale’s and five sub-scales’ internal consistency is quite high. The FLSS is expected to offer a comprehensive evaluation of the acquisition of four language skills in foreign language teaching programs.

🔖

Cite This Article

ARSLAN, R. Ş. (2022). The Development of a Scale to Evaluate Foreign Language Skills at Preparatory Schools. International Journal of Assessment Tools in Education, Cilt: 7 - Sayı: 2, 223–235. https://ajindex.com/articles/540130

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. Akpur, U., Alcı, B., & Karataş, H. (2016). Evaluation of the curriculum of English preparatory classes at Yildiz Technical University using CIPP model. Educational Research and Reviews, 11(7), 466-473.
  2. Balcı, A. (2009). Sosyal bilimlerde araştırma: yöntem, teknik ve ilkeler. Ankara:
  3. PegemA Yayıncılık. Balcı, Ö., Durak Üğüten, S., & Çolak, F. (2018). Zorunlu İngilizce hazirlik programinin değerlendirilmesi: Necmettin Erbakan Üniversitesi yabancı diller yüksekokulu örneği [The evaluation of compulsory preparatory program: The case of Necmettin Erbakan University school of foreign languages]. Kuramsal Eğitim Bilim Dergisi, 11(4), 860-893.
  4. Baykul, Y. (2000). Eğitimde ve psikolojide ölçme: klasik test teorisi ve uygulaması. Ankara:
  5. ÖSYM Yayınları.
  6. Bayram, N. (2013). Yapısal eşitlik modellemesine giriş (2. baskı). Bursa: Ezgi Kitabevi.
  7. Black, P, Harrison, C, Lee, C., Marshall, B., & Wiliam, D. (2004) Working inside the Black Box: assessment for learning in the classroom. Phi Delta Kappan, 86(1), 8-21.
  8. Büyüköztürk, Ş. (2002). Sosyal bilimler için veri analizi el kitabı. Ankara:
  9. PegemA Yayıncılık. Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates. Coşkun, A. (2013). An investigation of the effectiveness of the modular general English language teaching preparatory program at a Turkish university. South African Journal of Education, 33(3). 1-18. Council of Europe (CoE). (2001). Common European framework of reference for languages: Learning, teaching, assessment. Strasbourg, France: Council of Europe. Cambridge University Press. Retrieved from https://www.coe.int/en/web/common european framework reference languages Ekşi, G. Y. (2017). Designing curriculum for second and foreign language studies. In A. Sarıçoban (Ed.), ELT methodology. Anı Yayıncılık: Ankara.
  10. Erarslan, A. (2019). Progressive vs modular system in preparatory school English language teaching program: A case of system change at a state university in Turkey. Dil ve Dilbilimi Çalışmaları Dergisi, 15(1), 83-97.
  11. Golob, T. F. (2003). Structural equation modeling for travel behavior research. Transportation Research, 37(1), 1-25.
  12. Gorsuch, R. L. (1983). Factor Analysis. Hillsdale: Lawrence Erlbaum Associates. Güllü, A. S. (2007). An evaluation of English program at Kozan Vocational School of Çukurova University: Students’ point of view (Unpublished master’s thesis). Çukurova University, The Graduate School of Social Sciences, English Lang