SavedAdd your journal

Journals / Eurasian Journal of Educational Research / 2019 / Cilt: 19 - Sayı: 79

Using Alignment Index and Polytomous Item Response Theory on Statistics Essay Test

Kana HIDAYATI
Budiyono -
Sugiman -
Pages
115–132
Publication Date
2019-01-20
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Implications for Research and Practice: The use of the alignment index contribution to the verification of content validity of essay test and the use of the IRT polytomous GPCM may provide reference for the use of appropriate measurement theory to determine the item characteristics of essay test.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Purpose: Essay test in mathematics, both in the form of restricted-response and extended-response, generally consist of polytomous scored items.
📊
Key Findings & Data:This study used alignment index to prove the content validity and IRT polytomous GPCM to determine the characteristics of test items in order to produce an essay test that could accurately measure the achievement of students on statistical materials.
💡
Conclusion & Impact:Implications for Research and Practice: The use of the alignment index contribution to the verification of content validity of essay test and the use of the IRT polytomous GPCM may provide reference for the use of appropriate measurement theory to determine the item characteristics of essay test.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Alignment · validity · reliability

Abstract

Purpose: Essay test in mathematics, both in the form of restricted-response and extended-response, generally consist of polytomous scored items. However, the essay test used by teachers in Indonesia has not been fully supported by sufficient quality evidence. There have been many studies focusing on the development of the essay test, but not many of them have applied the use of relevant measurement theory for the polytomous data. The evidence of content validity also has not been supported by its alignment with the curriculum. This study used alignment index to prove the content validity and IRT polytomous GPCM to determine the characteristics of test items in order to produce an essay test that could accurately measure the achievement of students on statistical materials. Method: Procedures of this study: (1) preparation of preliminary test, (2) trials, (3) interpretation. Trial was conducted involving 688 Junior High School students in Yogyakarta, Indonesia. Results: The content validity of the test was good, supported by V Aiken index of 0.88–1.00 and Porter alignment index of 0.93. The test items had good construct validity. Test reliability was categorized as good with the Construct Reliability coefficient of 0.88 and the Alpha coefficient of 0.78. Judging from its characteristics, all test items were categorized as good. Implications for Research and Practice: The use of the alignment index contribution to the verification of content validity of essay test and the use of the IRT polytomous GPCM may provide reference for the use of appropriate measurement theory to determine the item characteristics of essay test.

🔖

Cite This Article

HIDAYATI, K., -, B., -, S. (2019). Using Alignment Index and Polytomous Item Response Theory on Statistics Essay Test. Eurasian Journal of Educational Research, Cilt: 19 - Sayı: 79, 115–132. https://ajindex.com/articles/31057

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (9)

  1. Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45, 131-142.
  2. Ananda, S. (2003). Rethinking issues of alignment under No Child Left Behind. San Francisco: WestEd. Anderson, D., Irvin, S., Alonzo, J., & Tindal, G. A. (2015). Gauging item alignment through online systems while controlling for rater effects. Educational Measurement: Issues and Practice, 34, 22-33.
  3. Anderson, L. W. & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing. A revision of Bloom’s taxonomy of educational objectives. New York: Addison Wesley Longman. Bhola, D. S., Impara, J. C., & Buchendahl, C. W. (2003). Aligning tests with states’ content standards: Methods and issues. Educational Measurement: Issues and Practice, 22(3), 21–29.
  4. Biggs, J. (2003). Teaching for quality learning at university. Glasgow: The Society for Research into Higher Education & Open University Press.
  5. Buhaerah. (2010). Pengembangan perangkat pembelajaran berdasarkan masalah pada materi statistika di kelas IX SMP. Gamatika. Nomor 1. Nopember. Crocker, L. & Algina, J. (1986). Introduction to classical and modern test theory. Belmont: Wadsworth Group. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of test. Psychometrika, 16, 297-334.
  6. Ebel, R. L. & Frisbie, D. A. (1991). Essentials of educational measurement. USA: Prentice-Hall Inc. Effendi, K. N. S. & Farlina, E. (2017). Kemampuan berpikir kreatif siswa SMP kelas VII dalam penyelesaian masalah statistika. Jurnal Analisa. 3(2). 130-138.
  7. Garson, G. D. (2009). Overview structural equation modeling, http://faculty.chass.ncsu.edu/garson/PA765/structur.htm.
  8. Guler, N. (2014). Analysis of open-ended statistics questions with many facet Rasch model. Eurasian Journal of Educational Research, 55, 73-90. http://dx.doi.org/10.14689/ejer.2014.55.5.
  9. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2009). Multivariate data analysis (7thed). Prentice Hall [versi elektronik]. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamental of item response theory. Newbury Park, CA: Sage Publication Inc. Hanjarwati, R. & Wiyarno, Y. (2015). Pengembangan bahan ajar matematika (materi statistik) dengan menggunakan model active learning sistem 5 M untuk siswa kelas VII. Jurnal Teknologi Pembelajaran Devosi. 5(2). Hasmi A., Hussain T., & Shoaib A. (2018). Alignment between Mathematics Curriculum and Textbook of Grade VIII in Punjab. Bulletin o