Journals / Uluslararası Mühendislik Araştırma ve Geliştirme Dergisi / 2022 / Cilt: 14 - Sayı: 3

Investigation of Error Numbers and Performance Scores of Air Traffic Controller Candidates in Real-time Simulation Scenarios

Hava Trafik Kontrolörü Adaylarının Gerçek Zamanlı Simülasyon Senaryolarındaki Hata Sayıları ve Performans Skorlarının İncelenmesi

Pages
87–97
Publication Date
2022-12-31
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

According to the results of the study, it was seen that the error numbers and performance scores supported each other.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:In this study, during the exercises in scenarios with four different levels of task difficulty (easy, medium, difficult, very difficult) designed depending on the number of aircraft and airspace structure in real-time simulations, mental workload was carried out on two different groups, who received simulation training and did not receive simulation training (experienced and inexperienced).
📊
Key Findings & Data:No significant difference was observed between the experienced and inexperienced groups in terms of reaction times.
💡
Conclusion & Impact:According to the results of the study, it was seen that the error numbers and performance scores supported each other.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:İnsan faktörleri · Hava trafik kontrolörü · Bilişsel iş yükü

Abstract

In this study, during the exercises in scenarios with four different levels of task difficulty (easy, medium, difficult, very difficult) designed depending on the number of aircraft and airspace structure in real-time simulations, mental workload was carried out on two different groups, who received simulation training and did not receive simulation training (experienced and inexperienced). A two-stage experimental process was carried out for multidimensional examination of mental workloads. In the first stage of the study, the reaction times of the participants before the simulation were evaluated over three different protocols using the FitLight Trainer system. No significant difference was observed between the experienced and inexperienced groups in terms of reaction times. In the second stage, these groups with homogeneous reaction times were compared with each other for the error numbers and performance scores of in real-time simulation scenarios. At the 90% confidence level, the experienced group made fewer mistakes. In addition, the different difficulty levels of the scenarios created a statistical difference in the error numbers. In easy-medium scenarios, students made statistically significantly fewer mistakes than in difficult-very difficult scenarios. Also, the changes of performance scores according to scenario difficulty levels were examined and it was revealed that there was a significant difference between performance scores (p-value=0,00 < 0,05). Students' performance scores were significantly higher in easy-medium scenarios compared to difficult-very difficult scenarios. According to the results of the study, it was seen that the error numbers and performance scores supported each other. It can be said that the difficulty levels of the scenarios have an effect on the cognitive workload (error numbers, performance scores).

Özet

Bu çalışmada gerçek zamanlı simülasyonlarda uçak sayısına ve hava sahası yapısına bağlı olarak tasarlanan dört farklı düzeydeki görev zorluğuna (kolay, orta, zor, çok zor) sahip senaryolardaki egzersizler boyunca, simülasyon eğitimini almış ve almamış (deneyimli-deneyimsiz) iki farklı grup üzerinde zihinsel iş yüklerinin çok boyutlu olarak incelenmesi için iki aşamalı bir deneysel süreç yürütülmüştür. Çalışmanın ilk aşamasında simülasyon öncesi katılımcıların reaksiyon süreleri FitLight Trainer sistemi kullanılarak üç farklı protokol üzerinden değerlendirilmiştir. Deneyimli ve deneyimsiz gruplar arasında reaksiyon süreleri bakımından anlamlı bir farklılık gözlenmemiştir. İkinci aşamada ise reaksiyon süreleri homojen olan bu grupların gerçek zamanlı simülasyon senaryolarında yaptıkları hata sayıları ve elde ettikleri performans skorları birbirleri ile kıyaslanmıştır. %90 güven seviyesinde deneyimli grup daha az hata yapmıştır. Ayrıca senaryoların farklı zorluk derecesinde olması hata sayılarında istatistiksel olarak farklılık yaratmıştır. Kolay-orta senaryolarda öğrenciler zor-çok zor senaryolara göre istatistiksel olarak anlamlı derecede daha az hata yapmışlardır. Bununla birlikte performans skorlarının senaryo zorluk derecelerine göre değişimleri incelenmiş ve performans skorları arasında anlamlı farklılık olduğu ortaya çıkmıştır (p-value=0,00 < 0,05). Kolay-orta senaryolarda zor-çok zor senaryolara göre öğrencilerin performans skorları anlamlı derecede yüksek çıkmıştır. Çalışma sonuçlarına göre hata sayıları ve performans skorlarının birbirini desteklediği görülmüştür. Senaryoların zorluk derecelerinin bilişsel iş yüküne (hata sayıları, performans skorları) etkisi olduğu söylenebilir.

🔖

Cite This Article

YAZGAN, E., ÇETEK, F. A., ŞİMŞEK, D., ATA, N., ERGİNEL, N., TUNCER, S., KARABAYRAK, B., AYDIN, A., DÖNMEZ, K., YILDIZLAR, Ç., TOKTAY, T. (2022). Investigation of Error Numbers and Performance Scores of Air Traffic Controller Candidates in Real-time Simulation Scenarios. Uluslararası Mühendislik Araştırma ve Geliştirme Dergisi, Cilt: 14 - Sayı: 3, 87–97. https://ajindex.com/articles/889069

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (7)

  1. Abbass, H. A., Tang, J., Ellejmi, M., & Kirby, S. (2014). Visual and auditory reaction time for air traffic controllers using quantitative electroencephalograph (QEEG) data. Brain Inform, 1(1-4):39-45. doi: 10.1007/s40708-014-0005-8
  2. Ackerman, P. L., & Cianciolo, A. T. (1999). Psychomotor abilities via touch‐panel testing: Measurement innovations, construct, and criterion validity. Human Performance, 12:3-4, 231-273. doi: 10.1080/08959289909539871 Ahlstrom, U., & Friedman-Berg, F. J. (2006). Using eye movement activity as a correlate of cognitive workload. International journal of industrial ergonomics, 36(7), 623-636. Antoško, M., Piľa, J., Korba, P., & Lipovský, P. (2014). Psychological readiness of air traffic controllers for their job. In: Our Sea 61(1-2): 5-8. - ISSN 0469-6255 Antoško, M., Sabo, J., Hovanec, M., Korba, P., & Sekelová, M. (2017). How to Evaluate the Actual Psychological Readiness of Atco. Proceedings of 20th International Scientific Conference, Transport Means 2017.
  3. Das, S., Gandhi, A., & Mondal, S. (1997). Effect of premenstrual stress on audiovisual reaction time and audiogram. Indian J Physiol Pharmacol, 41(1):67-70.
  4. Djokic, J., Lorenz, B., & Fricke, H. (2010). Air traffic control complexity as workload driver. Transp. Res. Part C Emerg. Technol., vol. 18, no. 6, pp. 930-936. doi: 10.1016/j.trc.2010.03.005 Eißfeldt, H., Heil, M. C., & Broach, D. (2002). Staffing the ATM System: The Selection of Air Traffic Controllers (1st ed.). Routledge. https://doi.org/10.4324/9781315242538 Federal Aviation Administration. (2021a). Air traffic organization policy. ORDER JO 7110.65Z. Federal Aviation Administration. (2021b). Forecasts of IFR aircraft handled by FAA air route traffic control centers. FY 2021–2040.
  5. Finkelman, J. M. (1994). A large database study of the factors associated with work-induced fatigue. Human Factors, 36(2), 232-243. Katanić, B., Ilić, P., Stojmenović, A., & Vitasović, M. (2020). The application of Fitlight trainer system in sports. Fizička kultura, 74(2), 115-126. https://doi.org/10.5937/fizkul74-27189
  6. Lesiuk, T. (2008). The effect of preferred music listening on stress levels of air traffic controllers. The Arts in Psychotherapy, 35(1), 1-10.
  7. Li, W. C., Moore, P., Zhang, J., Lin, J., & Kearney, P. (2022). The impact of out-the-window size on air traffic controllers’ visual behaviours and response time on digital tower operations. International Journal of Human-Computer Studies, Volume 166, 102880, ISSN 1071-5819. https:/