Journals / Novitas-Royal / 2011 / Cilt: 5 - Sayı: 1

Managıng task-related trouble ın l2 oral profıcıency tests: contrastıng ınteractıon data and rater assessment

Pages
91–120
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Given that students were assessed not only on their linguistic skills, but also on their interactional ability and treatment of topics assigned, our emphasis on task management stems from a hypothesis that orientation to the test task is intimately connected to overall test outcome.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The present study takes as an empirical point of departure the nature of interaction in second language speaking tests.
📊
Key Findings & Data:We examine the relationship between ratings of students’ performance in an oral proficiency test and the social practice of conducting ‘test talk’.
💡
Conclusion & Impact:Given that students were assessed not only on their linguistic skills, but also on their interactional ability and treatment of topics assigned, our emphasis on task management stems from a hypothesis that orientation to the test task is intimately connected to overall test outcome.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Abstract

The present study takes as an empirical point of departure the nature of interaction in second language speaking tests. We examine the relationship between ratings of students’ performance in an oral proficiency test and the social practice of conducting ‘test talk’. Using conversation analysis, our focal point is how students in peer- driven test interactions manage trouble related to the task-at-hand. Given that students were assessed not only on their linguistic skills, but also on their interactional ability and treatment of topics assigned, our emphasis on task management stems from a hypothesis that orientation to the test task is intimately connected to overall test outcome. We demonstrate that different types of task-related trouble (TRT) reveal diverse understandings of the test task and that ‘doing-being a successful task manager’ is connected to a moderate orientation to the task and test format. Students displaying such task management strategies were also assessed as highly proficient, whereas other task management strategies identified in our study correlated with low scores and grades. However, the relationship between subskill ratings and task management was not always clear-cut. We argue that the diverging understandings of the test task that learners display become part of how they are assessed and that certain task management strategies are rated less favorably than others. Our study holds promise for the fine-tuning of oral proficiency subskill ratings and raises questions as to the framing of test tasks, since this appears to have implications for student performance and evaluation.

Özet

Bu çalışma deneysel bir çıkış noktası olarak ikinci dil konuşma testlerindeki etkileşimin doğasını temel almaktadır. Öğrencilerin sözlü yeterlilik testlerindeki performansı ile ‘test konuşması’ yönetimi sosyal uygulaması arasındaki ilişkiyi incelemekteyiz. Temel odak noktamız konuşma çözümlemesi kullanarak öğrecilerin akranlarıyla yürüttükleri test etkileşimlerinde aktiviteye bağlı problemlerle nasıl başa çıktıklarıdır. Öğrencilerin sadece dilbilimsel yeteneklerinin değil ayni zamanda etkileşimsel yeteneklerinin ve kendilerine verilen konuyu ele alışlarının da ölçüldüğünü göz önünde bulundurarak, etkinlik yönetimi üzerine olan vurgumuz ‘test etkinliğine yönelim genel test neticesine derinlemesine bağlıdır’ varsayımından yola çıkmaktadır. Aktivite-ilintili Sorunların (AİS) farklı çeşitlerinin muhtelif test aktivitesi anlayışlarını ortaya çıkardığını ve ‘iyi bir aktivite yöneticisi olabilmenin’ aktiviteye ve test biçimine ölçülü bir yaklaşıma bağlı olduğunu göstermekteyiz. Bu aktivite yönetme stratejilerini uygulayabildiğini gösteren öğrenciler aynı zamanda yüksek derecede yetkin olarak ölçülmüşlerdir, ancak çalışmamızda belirlediğimiz diğer aktivite yönetim stratejileri düşük notlar ile ilişkilendirilmiştir. Fakat, alt-beceri değerlendirmeleri ile görev yönetimi arasındaki ilişki her zaman çok açık olmamıştır. Öğrencilerin gösterdiği farklı test anlayışlarının nasıl değerlendirildiklerinin bir parçası olduğunu ve belirli aktivite yönetim stratejilerinin daha az uygun olarak ölçüldüğünü savunmaktayız. Çalışmamızın sözlü yeterlilik alt-beceri ölçülerinin geçerliğini sağladığına ve öğrenci performansı ve değerlendirmesi ile alakalı sonuçları olduğu için de test görevlerinin tasarlanması konusunu sorguladığına inanmaktayız.

🔖

Cite This Article

SANDLUND, E., SUNDQVIST, P. (2011). Managıng task-related trouble ın l2 oral profıcıency tests: contrastıng ınteractıon data and rater assessment. Novitas-Royal, Cilt: 5 - Sayı: 1, 91–120. https://ajindex.com/articles/290961

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (11)

  1. Bernsten, S. G. (2002). Using Conversation Analysis to evaluate pre-sequences in invitation, offer and request dialogues in ESL textbooks. University of Illinois, Urbana- Champaign. Bowles, H. (2006). Bridging the gap between conversation analysis and ESP- an applied study of the opening sequences of NS and NNS service telephone calls. English for Specific Purposes. 25, 332-357.
  2. Bowles, H. (2011). The contribution of CA to the study of literary dialogue. Novitas-ROYAL (Research on Youth and Language). 5(1), 161-168. Retrieved from http://www.novitasroyal.org/Vol_5_1/bowles.pdf
  3. Brown, A. (2003). Interviewer variation and the co-construction of speaking proficiency. Language Testing, 20(1), 1-25.
  4. Brown, T.P. and Lewis, M. (2003). An ESP project: Analysis of an authentic workplace conversation. English for Specific Purposes. 22, 93-98.
  5. Brouwer, C. (2003). Word searches in NNS-NS interaction: Opportunities for language learning? The Modern Language Journal, 87(4), 534-545.
  6. Brouwer, C. E. and Wagner, J. (2004). Developmental issues in second language conversation. Journal of Applied Linguistics. 1(1), 30-47.
  7. Carroll, D. (2005). Learning through interactive talk: A school-based mentor teacher study group as a context for professional learning. Teacher and Teacher Education. 21, 457- 473. Cekaite, A. (2007). A child’s development of interactional competence in a Swedish L2 classroom. The Modern Language Journal. 91(1), 45-62.
  8. Christodoulidou, M. (2011). Lexical markers within the university lecture. Novitas-ROYAL (Research on Youth and Language). 5(1), 143-160. Retrieved from http://www.novitasroyal.org/Vol_5_1/chistodoulidou.pdf
  9. Cook, V. (2007). The nature of the L2 user. In Roberts, L., Gurel, A., Tatar, S. and Marti, L. (eds). EUROSLA Yearbook. 7, 205-20.
  10. Durus, N., Ludwig, M., Sert, O., Steinkraus, R. and Ziegler, G. (2010). Turn-initials as learners’ participation devices: “turning out” in ELF discourse. New Insights into the Study of Conversation: Applications to the Language Classroom. May 26-28, 2010.
  11. University of Granada, Granada, Spain. Egbert, M. (1998). Miscommunication in language proficiency interviews of first-year German students: comparison with natural conversation. In R. Young & A. He (Eds.), Talking and Testing: Discourse Approaches to the Assessment of Oral Proficiency (pp. 147-69). Amsterdam: Benjamins. Evnitskaya, N. and Morton, T. (2011). Knowledge construction, meaning-making and interaction in CLIL science classroom communities of prac