Journals / International Journal of Assessment Tools in Education / 2020 / Cilt: 7 - Sayı: 1

Use of Item Response Theory to Validate Cyberbullying Sensibility Scale for University Students

Pages
18–29
Publication Date
2022-10-19
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

With the validation process, the CSS will be a valuable measurement tool to determine the level of cyberbullying sensibility among university students and allow academicians to conduct research with this population.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:A thirteen-item cyberbullying sensibility scale (CSS), developed by Tanrıkulu, Kınay, and Arıcak (2013) and extensively used by researchers, was used to measure the cyberbullying sensibility levels of high school students.
📊
Key Findings & Data:In this study, the data obtained from 727 university students were analyzed based on item response theory (IRT) techniques, and psychometric evidences were obtained to evaluate whether it is appropriate to use the scale on the university students.
💡
Conclusion & Impact:With the validation process, the CSS will be a valuable measurement tool to determine the level of cyberbullying sensibility among university students and allow academicians to conduct research with this population.
🔬Design:Modeling & Simulation
📍Scope:2013 Verileri
⚙️Variables:Cyberbullying sensibility · Test validation · Item response theory

Abstract

A thirteen-item cyberbullying sensibility scale (CSS), developed by Tanrıkulu, Kınay, and Arıcak (2013) and extensively used by researchers, was used to measure the cyberbullying sensibility levels of high school students. Unlike other similar concepts, such as cyberbullying and cyber victimization, there are no scales developed to measure the cyberbullying sensibility among university students. In this study, the data obtained from 727 university students were analyzed based on item response theory (IRT) techniques, and psychometric evidences were obtained to evaluate whether it is appropriate to use the scale on the university students. Accordingly, a parameterization of CSS items was performed by using the graded response model. Using the discrimination parameters and item fit statistics, some items were removed from the original scale and a seven-item CSS version was developed since preliminary exploratory and confirmatory factor analyses provide inadequate evidence for the validity of a one-dimensional structure of cyberbullying sensibility. However, an IRT-based item removal process yielded an acceptable improvement. In this way, despite the six items being removed from the original CSS form, the scale retained 64% of the information it provided. The reliability values computed based on the classical approach and IRT were above .8 after the item elimination process with only a minor drop. With the validation process, the CSS will be a valuable measurement tool to determine the level of cyberbullying sensibility among university students and allow academicians to conduct research with this population.

Özet

A thirteen-item cyberbullying sensibility scale (CSS), developed by Tanrıkulu, Kınay, and Arıcak (2013) and extensively used by researchers, was used to measure the cyberbullying sensibility levels of high school students. Unlike other similar concepts, such as cyberbullying and cyber victimization, there are no scales developed to measure the cyberbullying sensibility among university students. In this study, the data obtained from 727 university students were analyzed based on item response theory (IRT) techniques, and psychometric evidences were obtained to evaluate whether it is appropriate to use the scale on the university students. Accordingly, a parameterization of CSS items was performed by using the graded response model. Using the discrimination parameters and item fit statistics, some items were removed from the original scale and a seven-item CSS version was developed since preliminary exploratory and confirmatory factor analyses provide inadequate evidence for the validity of a one-dimensional structure of cyberbullying sensibility. However, an IRT-based item removal process yielded an acceptable improvement. In this way, despite the six items being removed from the original CSS form, the scale retained 64% of the information it provided. The reliability values computed based on the classical approach and IRT were above .8 after the item elimination process with only a minor drop. With the validation process, the CSS will be a valuable measurement tool to determine the level of cyberbullying sensibility among university students and allow academicians to conduct research with this population.

🔖

Cite This Article

ARICAK, O. T., TOPÇU, F., AVCU, A., TUTLU, M. G. (2022). Use of Item Response Theory to Validate Cyberbullying Sensibility Scale for University Students. International Journal of Assessment Tools in Education, Cilt: 7 - Sayı: 1, 18–29. https://ajindex.com/articles/540109

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (8)

  1. Álvarez-García, D., Núñez, J.C., González-Castro, P., Rodríguez, C., & Cerezo, R. (2019) The Effect of Parental Control on Cyber-Victimization in Adolescence: The Mediating Role of Impulsivity and High-Risk Behaviors. Front. Psychol., 10, 1159. Ang, R.P., & Goh, D.H. (2010). Cyberbullying among adolescents: The role of affective and cognitive empathy, and gender. Child Psychiatry & Human Development, 41(4), 387-397.
  2. Bilker, W.B., Hansen, J. A., Brensinger, C. M., Richard, J., Gur, R. E., & Gur, R. C. (2012). Development of abbreviated nine-item forms of the Raven's standard progressive matrices test. Assessment, 19(3), 354-369.
  3. Baker, F.B. (2001). The basics of item response theory (2nd ed.). College Park, MD: ERIC Clearinghouse on Assessment and Evaluation, University of Maryland. Retrieved February, 3 2019 from http://files.eric.ed.gov/fulltext/ED458219.pdf
  4. Baştak, G., & Altınova, H.H. (2015). Lise Öğrencilerinde Yaratıcı Drama Yöntemiyle Siber Zorbalık Hakkında Duyarlılık Oluşturma. Yaratıcı Drama Dergisi, 10(1), 91-102.
  5. Chalmers, R.P. (2012). mirt: A Multidimensional Item Response Theory Package for the R Environment. Journal of Statistical Software, 48(6), 1-29.
  6. Doğan, E., Cansu, Ç., & Şahin, Y.L. (2016). A Study on Online Social Network Games Players’ Cyberbullying Sensibility and Aims of Facebook Usage/Çevrimiçi Sosyal Ağ Oyunu Oynayan Bireylerin Siber Zorbaliğa Duyarlılık Düzeyleri ile Facebook Kullanım Amaçları Üzerine Bir Çalışma. Eğitimde Kuram ve Uygulama, 12(3), 501-520.
  7. Embretson, S., Reise, S.P. (2000). Item Response Theory for Psychologists. Lawrence Erlbaum Associates. Inc. Mahwah. Gaffney, H., Farrington, D. P., Espelage, D. L., and Ttofi, M. M. (2019). Are cyberbullying intervention and prevention programs effective? a systematic and meta-analytical review. Aggress. Violent Behav. 45, 134–153. doi: 10.1016/j.avb.2018.07.002 Gahagan, K., Vaterlaus, J.M., & Frost, L.R. (2016). College student cyberbullying on social networking sites: Conceptualization. prevalence. and perceived bystander responsibility. Computers in human behavior, 55, 1097-1105.
  8. Hambleton, R.K, Swaminathan, H., Rogers, H.J. (1991). Fundamentals of Item Response Theory. Thousand Oaks: Sage Publications. Hambleton, R.K., Robin, F., & Xing, D. (2000). Item response models for the analysis of educational and psychological test data. In: Tinsley HEA. Brown SD. editors. Handbook of Applied Multivariate Statistics and Mathematical Modeling. San Diego: Academic. p. 553–85. Hamble