Journals / Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi / 2019 / Cilt: 10 - Sayı: 2

Estimation and Standardization of Variance Parameters for Planning Cluster-Randomized Trials: A Short Guide for Researchers

Pages
179–201
Publication Date
2019-06-28
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Finally, we provide example statistical power and minimum required sample size calculations.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:A review of literature covering the past decade indicates a shortage of cluster-randomized trials (CRTs) in education and psychology in Turkey, the gold standard that is capable of producing high-quality evidence for high-stake decision making when individual randomization is not feasible.
📊
Key Findings & Data:In this illustration, we demonstrate how to estimate variance parameters from existing data and transform them into standardized forms so that they can be used in planning sufficiently powered CRTs.
💡
Conclusion & Impact:Finally, we provide example statistical power and minimum required sample size calculations.
🔬Design:Review & Systematic Survey
📍Scope:Comprehensive Sample
⚙️Variables:seçkisiz-küme deneyleri · varyans kestirimi · istatistiksel güç analizi

Abstract

A review of literature covering the past decade indicates a shortage of cluster-randomized trials (CRTs) in education and psychology in Turkey, the gold standard that is capable of producing high-quality evidence for high-stake decision making when individual randomization is not feasible. Scarcity of CRTs is not only detrimental to collective knowledge on the effectiveness of interventions but also hinders efficient design of such studies as prior information is at best incomplete or unavailable. In this illustration, we demonstrate how to estimate variance parameters from existing data and transform them into standardized forms so that they can be used in planning sufficiently powered CRTs. The illustration uses publicly available software and guides researchers step by step via introducing statistical models, defining parameters, relating them to notations in statistical models and power formulas, and estimating variance parameters. Finally, we provide example statistical power and minimum required sample size calculations.

Özet

Geçtiğimiz on yılı kapsayan literatür taraması, bireysel seçkisiz atamanın mümkün olmadığı durumlarda, önemli kararlar alınırken etkili kanıt üretebilecek altın standardındaki seçkisiz-küme deneylerinin (SKD) Türkiye'de eğitim ve psikoloji alanlarında yetersiz sayıda olduğunu göstermektedir. SKD sayısının azlığı sadece programın etkililiği konusunda toplam bilgiye zarar vermekle kalmayıp, önceki bilgiler mevcut olmadığından veya en iyi ihtimalle eksik olduğundan bu tür çalışmaların etkili bir şekilde tasarlanmasını da engellemektedir. Bu çalışmada, mevcut verilerden yola çıkarak varyans parametrelerinin nasıl kestirilebileceği, nasıl standart formlara dönüştürülebileceği ve böylece bunların nasıl yeteri kadar güçlü SKD’lerin planlanmasında kullanılabileceği gösterilmiştir. Bu çalışmada belirtilen amacı gerçekleştirmek üzere halka açık yazılım kullanılmıştır. Burada istatistiksel modelleri tanıtıp, parametreleri tanımlayarak, istatistiksel model ve güç formüllerinde varyans parametrelerini tahmini gösterimlerle (notasyon) ilişkilendirerek araştırmacılara adım adım rehberlik edilmeye çalışılmıştır.

🔖

Cite This Article

BULUŞ, M., ŞAHİN, S. G. (2019). Estimation and Standardization of Variance Parameters for Planning Cluster-Randomized Trials: A Short Guide for Researchers. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, Cilt: 10 - Sayı: 2, 179–201. https://ajindex.com/articles/137307

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. Bland J. M. (2004). Cluster randomized trials in the medical literature: two bibliometric surveys. BMC Medical Research Methodology, 4(21). DOI: https://doi.org/10.1186/1471-2288-4-21
  2. Bloom, H. S. (1995). Minimum detectable effects a simple way to report the statistical power of experimental designs. Evaluation Review, 19(5), 547-556. DOI: https://doi.org/10.1177/0193841X9501900504
  3. Bloom, H. S. (2006). The core analytics of randomized experiments for social research. MDRC Working Papers on Research Methodology. New York, NY: MDRC. Retrieved from DOI: https://www.mdrc.org/sites/default/files/full_533.pdf.
  4. Bloom, H. S., Bos, J. M., & Lee, S. W. (1999). Using cluster random assignment to measure program impacts statistical implications for the evaluation of education programs. Evaluation Review, 23(4), 445-469. DOI: https://doi.org/10.1177%2F0193841X9902300405
  5. Bulus, M., Dong, N., Kelcey, B., & Spybrook, J. (2019). PowerUpR: Power Analysis Tools for Multilevel Randomized Experiments. R package version 1.0.4. DOI: https://CRAN.R-project.org/package=PowerUpR
  6. Cameron, A. C., & Miller, d. L. (2015). A practitioner’s guide to cluster-robust inference. Journal of Human Resources, 50, 317-372. DOI: https://doi.org/10.3368/jhr.50.2.317
  7. Dong, N., & Maynard, R. (2013). PowerUp!: A Tool for Calculating Minimum Detectable Effect Sizes and Minimum Required Sample Sizes for Experimental and Quasi-experimental Design Studies. Journal of Research on Educational Effectiveness, 6(1), 24-67. DOI: https://doi.org/10.1080/19345747.2012.673143
  8. Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1-48. DOI: https://doi.org/10.18637/jss.v067.i01
  9. Hayes, R. J. & Moulton, L. H. (2017). Cluster Randomized Trials (2nd ed.). New York, NY: Chapman and Hall/CRC Press. DOI: https://doi.org/10.4324/9781315370286
  10. Hedberg, E. C. (2016). Academic and behavioral design parameters for cluster randomized trials in kindergarten: an analysis of the Early Childhood Longitudinal Study 2011 Kindergarten Cohort (ECLS-K 2011). Evaluation Review, 40(4), 279-313. DOI: https://doi.org/10.1177/0193841X16655657
  11. Hedberg, E. C., & Hedges, L. V. (2014). Reference values of within-district intraclass correlations of academic achievement by district characteristics: Results from a meta-analysis of district-specific values. Evaluation Review, 38(6), 546-582. DOI: https://doi.org/10.1177/0193841X14554212
  12. Hedges, L. V., & Hedb