Journals / Participatory Educational Research / 2022 / Cilt: 9 - Sayı: 3

Development and use of a rubric to assess undergraduates’ problem solutions in Physics

Pages
362–382
Publication Date
2022-05-01
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

In light of the findings obtained from the study, it was concluded that the developed rubric helped to make consistent and stable ratings independent of the scorer, to determine the characteristics of the problem solutions and to increase the level of achievement of students.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The aim of this study is to develop and apply a rubric to evaluate the solutions proposed for questions about electromagnetic induction belonging to university second year pre-service teachers.
📊
Key Findings & Data:In this study which has pretest-posttest quasi-experimental design with control group, teaching of the topic of electromagnetic induction was applied to both groups with the same teaching method and a test consisting of four questions was applied before and after the teaching. 73 students in the experimental group were informed about the properties and usage of rubrics and asked to create a rubric.
💡
Conclusion & Impact:In light of the findings obtained from the study, it was concluded that the developed rubric helped to make consistent and stable ratings independent of the scorer, to determine the characteristics of the problem solutions and to increase the level of achievement of students.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:electromagnetic induction · rubric development · university physics

Abstract

The aim of this study is to develop and apply a rubric to evaluate the solutions proposed for questions about electromagnetic induction belonging to university second year pre-service teachers. In this study which has pretest-posttest quasi-experimental design with control group, teaching of the topic of electromagnetic induction was applied to both groups with the same teaching method and a test consisting of four questions was applied before and after the teaching. 73 students in the experimental group were informed about the properties and usage of rubrics and asked to create a rubric. The effect of rubric on the success of students was examined by applying descriptive statistics and t-tests to the scores obtained from both tests. The validity and reliability of the scoring with rubric were analyzed by calculating the linear regression, t-test statistics, Pearson correlation, Intraclass correlation and Cronbach-alpha correlation coefficients. The results of the analyses show that the developed rubric was used consistently by the researcher and an independent coder and there was a high and significant (p=.000) relationship between the scores for all questions. In the inter-rater reliability analysis for each question, the lowest ICC coefficient was specified as .826. In light of the findings obtained from the study, it was concluded that the developed rubric helped to make consistent and stable ratings independent of the scorer, to determine the characteristics of the problem solutions and to increase the level of achievement of students. Another type of analytical rubric can be created and used for other topics of the area of Physics and the results can be compared with the findings of this study.

🔖

Cite This Article

KOCAKÜLAH, A. (2022). Development and use of a rubric to assess undergraduates’ problem solutions in Physics. Participatory Educational Research, Cilt: 9 - Sayı: 3, 362–382. https://ajindex.com/articles/720588

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. Albe, V., Venturini, P., & Lascours, J. (2001). Electromagnetic concepts in mathematical representation of physics. Journal of Science Education and Technology, 10, 197-203.
  2. Andrade, H., Wang, X. L., Du, Y., & Akawi, R. L. (2009). Rubric-referenced self-assessment and self-efficacy for writing. Journal of Educational Research, 102(4), 287-301.
  3. Andrade, H., & Du, Y. (2005). Student perspectives on rubric-referenced assessment. Practical Assessment, Research & Evaluation. http://pareonline.net/getvn.asp?v=10&n=3.
  4. Angell, K. (2015). The application of reliability and validity measures to assess the effectiveness of an undergraduate citation rubric. Behavioral and Social Sciences Librarian, 34(1), 2-15.
  5. Beer, C. P. (2010). How do pre-service teachers picture various electromagnetic phenomenon? A qualitative study of pre-service teachers’ conceptual understanding of fundamental electromagnetic interaction. [Doctoral dissertation]. Ball State University. Brookhart, S. M., & Chen, F. (2015). The quality and effectiveness of descriptive rubrics. Educational Review, 67(3), 343-368.
  6. Caleon, I., & Subramaniam, R. (2005). The impact of a cryogenics-based enrichment programme on attitude towards science and the learning of science concepts. International Journal of Science Education, 27(6), 679-704.
  7. Cheng, M. W. T., & Chan, C. K. Y. (2019). An experimental test: Using rubrics for reflective writing to develop reflection. Studies in Educational Evaluation, 61, 176-182.
  8. Claesgens, C., Scalise, K., Wilson, M., & Stacy, A. (2009). Mapping student understanding in chemistry: The perpectives of chemists. Science Education, 93(1), 56-85.
  9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York: Lawrance Erlbaum Associates. Dattalo, P. (2008). Determining sample size: Balancing power, precision and practicality. Oxford: Oxford University Press.
  10. Dori, Y. J., & Belcher, J. (2005). How does technology-enabled active learning affect undergraduate students’ understanding of electromagnetism concepts? Journal of the Learning Sciences, 14(2), 243-279.
  11. Gaigher, E., Rogan, J. M., & Braun, M. W. H. (2007). Exploring the development of conceptual understanding through structured problem-solving in physics. International Journal of Science Education, 29(9), 1089-1110.
  12. Gray, J. S., Connolly, J. P., & Brown, M. A. (2019). Measuring intercultural knowledge and competence in college essays: Does a performance-based rubric have construct validity? Studies in Education