Investigation of Usage Frequency and Department on Usability Issues with the Online Examination System (OSSI)

Abstract

Usability is an important term for systems related to learning and teaching because usability issues can negatively affect student achievement. The aim of this study is to investigate the usability of a specific online examination system, OSSI, which is used by a public university for midterm and final exams. Researchers examined mean differences between System Usability Scale (SUS) scores of students from different departments with different usage frequencies. Usability issues were investigated by gathering students’ ideas. Both quantitative and qualitative data procedures were employed. Quantitative data were analyzed through analysis of variance, while content analysis was applied to qualitative data. Scores showed no statistical mean difference between usage frequencies but did show a statistically significant mean difference between CEIT and other two departments. Qualitative analysis revealed the importance of screen size, placement of buttons, question formatting, and other screen elements. The results of this study contribute to the design and development of OSSI and other online examination systems.