Journals / Türkbilig / 2025 / Cilt: 2025 Sayı: 50

DESIGN OF AN AI-SUPPORTED PROTOTYPE APPLICATION FOR ASSESSING WRITING SKILLS IN TURKISH AS A FOREIGN AND SECOND LANGUAGE

Yabancı Dil ve İkinci Dil Olarak Türkçe Öğretiminde Yazma Becerisinin Değerlendirilmesine Yönelik Yapay Zekâ Destekli Bir Uygulama Prototipinin Tasarımı

Kadir Coşkun(KASTAMONU UNIVERSITY, FACULTY OF EDUCATION)0000-0001-5771-9954
Mustafa Durmuş(HACETTEPE UNIVERSITY, INSTITUTE OF TURKIC STUDIES)0000-0002-5337-3113
Journal
Türkbilig
Pages
241–261
Publication Date
2025-12-30
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

It is believed that the effectiveness and sustainability of this model, which differs from current practices by aiming to provide a learning environment where learners and instructors come together to teach Turkish as a foreign and second language by taking advantage of the potential offered by artificial intelligence, will be increased with future research.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Recent advancements in artificial intelligence technologies have introduced innovative educational approaches, making learning processes richer and more accessible.
📊
Key Findings & Data:This study introduces an AI-supported web application that assesses the writing of learners of Turkish as a foreign or second language and functions seamlessly in hybrid and distance-learning settings.
💡
Conclusion & Impact:It is believed that the effectiveness and sustainability of this model, which differs from current practices by aiming to provide a learning environment where learners and instructors come together to teach Turkish as a foreign and second language by taking advantage of the potential offered by artificial intelligence, will be increased with future research.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Teaching Turkish as a foreign language · automated writing evaluation · artificial intelligence in language assessment

Abstract

Recent advancements in artificial intelligence technologies have introduced innovative educational approaches, making learning processes richer and more accessible. This study introduces an AI-supported web application that assesses the writing of learners of Turkish as a foreign or second language and functions seamlessly in hybrid and distance-learning settings. Within the developed application, instructors can create writing activities for learners in their classes, and learners can create texts using these activity guidelines and share them with instructors. Learners' written products are scored based on the activity guidelines using an analytical rubric, developed through artificial intelligence, covering form, content, and grammar. The rubric scores and artificial intelligence feedback obtained from the evaluation are presented to learners, who can revise their texts in line with the feedback they receive. Instructors can mark errors in completed learner texts, add explanations, and contribute to the system with rubric scores. In addition, the application was developed to create a dataset that instructors and institution managers can use when planning their teaching processes. It provides the compilation and recording of indicators such as the number of errors in learner texts, learner vocabulary, writing speed, word and sentence lengths on a process-based basis. It is believed that the effectiveness and sustainability of this model, which differs from current practices by aiming to provide a learning environment where learners and instructors come together to teach Turkish as a foreign and second language by taking advantage of the potential offered by artificial intelligence, will be increased with future research.

Özet

Son yıllarda yapay zekâ teknolojilerindeki hızlı gelişmeler, eğitim alanında yenilikçi yaklaşımların ortaya çıkmasını sağlamış ve öğrenme süreçlerini daha zengin ve erişilebilir hâle getirmiştir. Bu doğrultuda gerçekleştirilen çalışmanın amacı, Türkçeyi yabancı veya ikinci dil olarak öğrenenlerin yazılı ürünlerini değerlendirmeye yönelik yapay zekâ destekli bir web tabanlı uygulama modeli geliştirmektir. Geliştirilen uygulama içerisinde öğreticiler kendilerine ait sınıflarda yer alan öğreniciler için yazma etkinlikleri oluşturabilmekte, öğreniciler ise bu etkinlik yönergelerine uygun olarak metinler oluşturup bunları öğreticilerle paylaşabilmektedir. Öğreniciler tarafından oluşturulan yazılı ürünler, yapay zekâ tarafından çalışma kapsamında geliştirilmiş olan biçim, içerik ve dilbilgisi boyutlarını kapsayan analitik rubrik çerçevesinde etkinlik yönergeleri dikkate alınarak puanlanmaktadır. Değerlendirme sonucunda elde edilen rubrik puanları ve yapay zekâ geri bildirimleri öğrenicilere sunulmakta, öğreniciler ise aldıkları geri bildirim doğrultusunda metinlerinde revizyon yapabilmektedirler. Öğreticiler, tamamlanmış öğrenici metinlerindeki hataları işaretleyip açıklamalar ekleyebilmekte ve rubrik puanlamalarıyla sisteme katkı sunabilmektedir. Ayrıca öğreticilerin ve kurum yöneticilerinin öğretim süreçlerini planlarken kullanabilecekleri bir veri kümesinin oluşturulması amacıyla geliştirilen uygulama; öğrenici metinlerindeki hata sayısı, öğrenici söz varlığı, yazma hızı, sözcük ve cümle uzunlukları gibi göstergelerin süreç bazlı olarak derleyerek kayıt altına alınması sağlamaktadır. Yapay zekânın sunduğu potansiyelden yararlanarak Türkçenin yabancı ve ikinci dil olarak öğretiminde öğrenici ve öğreticilerin bir arada olduğu bir öğrenme ortamı sağlamayı amaçlayarak mevcut uygulamalardan farklılaşan bu modelin etkinliğinin ve sürdürülebilirliğinin ileride gerçekleştirilecek araştırmalarla artırılacağına inanılmaktadır.

🔖

Cite This Article

Coşkun, K., Durmuş, M. (2025). DESIGN OF AN AI-SUPPORTED PROTOTYPE APPLICATION FOR ASSESSING WRITING SKILLS IN TURKISH AS A FOREIGN AND SECOND LANGUAGE. Türkbilig, Cilt: 2025 Sayı: 50, 241–261. https://doi.org/10.59257/turkbilig.1685958

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (41)

  1. Abdelrahim, Y. (2021). How COVID-19 quarantine influenced online exam cheating: A case of Bangladesh University students. Journal of Southwest Jiaotong University, 56(1), Article 18. https://doi.org/10.35741/issn.0258-2724.56.1.18
  2. Alessio, H. M., Malay, N., Maurer, K., Bailer, A. J. & Rubin, B. (2018). Interaction of proctoring and student major on online test performance. The International Review of Research in Open and Distributed Learning, 19(5). https://doi.org/10.19173/irrodl.v19i5.3698
  3. Atoum, Y., Chen, L., Liu, A. X., Hsu, S. D. H. & Liu, X. (2017). Automated online exam proctoring. IEEE Transactions on Multimedia, 19(7), 1609–1624. https://doi.org/10.1109/tmm.2017.2656064
  4. Barab, S. & Squire, K. (2004). Design-based research: Putting a stake in the ground. Journal of the Learning Sciences, 13(1), 1–14. https://doi.org/10.1207/s15327809jls1301_1
  5. Barnett, D. C. & Dalton, J. C. (1981). Why college students cheat. Journal of College Student Personnel, 22(6), 545–551. https://eric.ed.gov/?id=ej253567
  6. Bennett, R. E. (2011). Formative assessment: a critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/0969594X.2010.513678
  7. Black, P. & Wiliam, D. (1998). Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102
  8. Bölükbaş, F., Yilmaz, Y. & Keskin, F. (2023a). Yeni İstanbul uluslararası öğrenciler için Türkçe A1 (8. Baskı). Kültür Sanat Yayınevi, Press Global.
  9. Bölükbaş, F., Yilmaz, Y. & Keskin, F. (2023b). Yeni İstanbul uluslararası öğrenciler için Türkçe A2 (8. Baskı). Kültür Sanat Yayınevi, Press Global.
  10. Burstein, J., Chodorow, M. & Leacock, C. (2004). Automated essay evaluation: The Criterion online writing service. AI Magazine, 25(3), 27–36. https://doi.org/10.1609/aimag.v25i3.1774
  11. Cizek, G. J. & Wollack, J. A. (2017). Exploring cheatings on tests: The context, the concern, and the challenges. In G. J. Cizek & J. A. Wollack (Eds.), Handbook of quantitative methods for detecting cheating on tests (ss. 3–19). Routledge Taylor & Francis Group.
  12. Coghlan, S., Miller, T. & Paterson, J. (2021). Good proctor or "big brother"? Ethics of online exam supervision technologies. Philosophy & Technology, 34(4), 1581–1606. https://doi.org/10.1007/s13347-021-00476-1
  13. Comas-Forgas, R., Lancaster, T., Calvo-Sastre, A. & Sureda-Negre, J. (2021). Exam cheating and academic integrity breaches during the COVID-19 pandemic: An analysis of internet search activity in Spain. Heliyon, 7(10), e08233. https://doi.org/10.1016/j.heliyon.2021.e08233
  14. Çangal, Ö., Çelik, M. E. & Başar, U. (2025). Yabancılara Türkçe öğretiminde yapay zekâ kullanımına yönelik öğretici görüşleri. Aydın Tömer Dil Dergisi, 10(1), 57–97. https://doi.org/10.17932/IAU.TOMER.2016.019/
  15. The Design-Based Research Collective (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8. https://doi.org/10.3102/0013189X032001005
  16. Faghih, B., Azadehfar, M. R. & Katebi, S. D. (2013). User interface design for e-learning software. International Journal of Soft Computing and Software Engineering, 3(3), 786–794. https://doi.org/10.7321/jscse.v3.n3.119
  17. Ghalib, T. K. A. & Al-Hattami, A. (2015). Holistic versus analytic evaluation of EFL writing: a case study. English Language Teaching, 8(7). https://doi.org/10.5539/elt.v8n7p225
  18. Howard, R. M. & Davies, L. J. (2009). Plagiarism in the internet age. Educational Leadership, 66(6), 64–67. https://eric.ed.gov/?id=ej834080
  19. Imran, A. M. & Nordin, M. S. (2013). Predicting the underlying factors of academic dishonesty among undergraduates in public universities: A Path Analysis Approach. Journal of Academic Ethics, 11(2), 103–120. https://doi.org/10.1007/s10805-013-9183-x
  20. Janke, S., Rudert, S. C., Petersen, Ä., Fritz, T. M. & Daumiller, M. (2021). Cheating in the wake of COVID-19: How dangerous is ad-hoc online testing for academic integrity? Computers and Education Open, 2, 100055. https://doi.org/10.1016/j.caeo.2021.100055
  21. Kasinathan, V., Yan, C. E., Mustapha, A., Abdul Hameed, V., Ching, T. H. & Thiruchelvam, V. (2022). Proctorex: An automated online exam proctoring system. Mathematical Statistician and Engineering Applications, 71(3s2), 876 – 889-876 – 889. http://philstat.org/special_issue/index.php/msea/article/view/320
  22. Khan, S. & Khan, R. A. (2019). Online assessments: Exploring perspectives of university students. Education and Information Technologies, 24(1), 661–677. https://doi.org/10.1007/s10639-018-9797-0
  23. King, C. G., Guyette, R. W., Piotrowski & Chris (2009). Online exams and cheating: An empirical analysis of business students' views. The Journal of Educators Online, 6(1), 1–11.
  24. Koe, L. S., Kustandi, C. & Siregar, E. (2024). AI-driven feedback system: Implementing advanced NLP and openAI for online learning. Jurnal Inovasi Dan Teknologi Pembelajaran, 11(3), 137–148. https://journal-fip.um.ac.id/index.php/jinotep/article/view/1326
  25. Lewis, R., Stoney, S. & Wild, M. (1998). Motivation and interface design: maximising learning opportunities. Journal of Computer Assisted Learning, 14(1), 40–50. https://doi.org/10.1046/j.1365-2729.1998.1410040.x
  26. Maramark, S. & Maline, M. B. (1993). Academic dishonesty among college students. Issues in education. Office of Educational Research and Improvement.
  27. Ocak, G. & Karakuş, G. (2021). Undergraduate students’ views of and difficulties in online exams during the COVID-19 pandemic. Themes in Science and Technology Education, 14, 13–30.
  28. OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., Avila, R., Babuschkin, I., Balaji, S., Balcom, V., Baltescu, P., Bao, H., Bavarian, M., Belgum, J.,. Zoph, B. (2023). GPT-4 technical report. Advance online publication. https://doi.org/10.48550/arXiv.2303.08774
  29. Polat, M. (2017). Why do students cheat in examinations in Turkey? A meta-synthesis study. Eğitim Bilimleri Araştırmaları Dergisi, 7(1), 203–222. https://doi.org/10.22521/jesr.2017.71.7
  30. Rowe, N. C. (2004). Cheating in online student assessment: Beyond plagiarism. Online Journal of Distance Learning Administration, 7(2), 1–10.
  31. Sakkir, G. & Dollah, S. (2019). Measuring students’ writing skills using Facebook group application in EFL context. International Journal of Humanities and Innovation (IJHI), 2(3). http://eprints.unm.ac.id/29923/
  32. Scanlon, P. M. & Neumann, D. R. (2002). Internet plagiarism among college students. Journal of College Student Development, 43(3), 374–385. https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=93619e5a4a7dac6591a799732cd7d6a0d2fe635a
  33. Shih, R.‑C. (2011). Can Web 2.0 technology assist college students in learning English writing? Integrating Facebook and peer assessment with blended learning. Australasian Journal of Educational Technology, 27(5). https://doi.org/10.14742/ajet.934
  34. Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795
  35. Sklar, J. (2012). Principles of web design (5th ed.). The web technologies series. Course Technology Cengage Learning.
  36. Uyar, Y. (2016). Yazma becerisini geliştirmeye yönelik araştırmalar: Son çeyrek asrın değerlendirilmesi. Turkish Studies, 11(3), 2273–2294. https://doi.org/10.7827/TurkishStudies.9479
  37. Warschauer, M. & Ware, P. (2006). Automated writing evaluation: defining the classroom research agenda. Language Teaching Research, 10(2), 157–180. https://doi.org/10.1191/1362168806lr190oa
  38. Wiseman, C. S. (2012). A comparison of the performance of analytic vs. holistic scoring rubrics to assess L2 writing. International Journal of Language Testing, 2(1), 59-92.
  39. World Wide Web Consortium. (2024, December 12). Web Content Accessibility Guidelines (WCAG) 2.2. https://www.w3.org/TR/WCAG22/
  40. Zou, M., Kong, D. & Lee, I. (2021). Teacher engagement with online formative assessment in EFL writing during COVID-19 Pandemic: The case of China. The Asia-Pacific Education Researcher, 30(6), 487–498. https://doi.org/10.1007/s40299-021-00593-7
  41. OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., Avila, R., Babuschkin, I., Balaji, S., Balcom, V., Baltescu, P., Bao, H., Bavarian, M., Belgum, J.,. Zoph, B. (2023). GPT-4 technical report. Advance online publication. https://doi.org/10.48550/arXiv.2303.08774