Psychometric Characteristics of a Test and Individualized Feedback via DINA Model: TIMSS 2015

Abstract

The aim of the study is to show how to use DINA model in defining psychometric characteristics of a test and giving students individualized feedback. The data of the study is taken from multiple-choice items in booklet-1 of eighth graders’ mathematics test of TIMSS 2015 Turkey sample. 435 students took booklet-1. The parameters of DINA model were estimated via R Studio and interpreted by comparing with CTT and IRT parameters. Additionally, diagnostic profile report example for individualized feedback was constructed. The result of the study shows that DINA model has a good fit (SRMSR, MADcor, MADQ3, MADaQ3, and RMSEA < 0.05). The parameters of DINA model are similar to those of CTT and IRT. The reliability values of DINA, CTT and IRT are (Pc)=0.913, KR-20=0.80 and marginal reliability=0.70, respectively. Thus, reliability of DINA model is bigger than the others’ values. As a result, it is suggested that DINA model can be used to report psychometric characteristics of a test. In addition, it can be used to give detailed individualized feedback to students, which is different from CTT and IRT.