Journals / Black Sea Journal of Engineering and Science / 2026 / Cilt: 9 Sayı: 5

Heterogeneous Mixture Distributions for Modeling Skewed Data in Engineering Applications: A Theoretical Approach

Pages
2249–2258
Publication Date
2026-09-15
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Future research should extend the framework to censored lifetime data, formalize component family selection procedures, and investigate Bayesian estimation alternatives.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Mixture distribution models have become indispensable tools for characterizing complex, non-Gaussian data structures that frequently arise in engineering and reliability contexts.
📊
Key Findings & Data:However, existing mixture frameworks predominantly assume homogeneous component families, typically Gaussian, which limits their capacity to represent data generated by fundamentally different physical mechanisms.
💡
Conclusion & Impact:Future research should extend the framework to censored lifetime data, formalize component family selection procedures, and investigate Bayesian estimation alternatives.
🔬Design:Modeling & Simulation
📍Scope:2000 Verileri
⚙️Variables:Heterogeneous mixture distribution · EM algorithm · Skewed data

Abstract

Mixture distribution models have become indispensable tools for characterizing complex, non-Gaussian data structures that frequently arise in engineering and reliability contexts. However, existing mixture frameworks predominantly assume homogeneous component families, typically Gaussian, which limits their capacity to represent data generated by fundamentally different physical mechanisms. This paper presents a formal theoretical framework for heterogeneous mixture distributions, in which component densities are drawn from distinct parametric families — specifically the Normal, Gamma, Weibull, and Lognormal distributions — with identifiability conditions formally established across the full family set. A unified parameter estimation strategy based on maximum likelihood and the Expectation-Maximization (EM) algorithm is developed, accommodating cross-family heterogeneity within a single iterative procedure. The framework is evaluated through a Monte Carlo simulation study comprising B = 500 independent replications with n = 2000 observations per replication, under two engineering-motivated scenarios: a two-component heterogeneous mixture (Weibull–Normal) designed to reflect early-failure and steady-state behavior, and a three-component mixture (Weibull–Normal–Lognormal) representing a full bathtub-curve reliability profile. Model performance is assessed using the Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC). The proposed heterogeneous models yield mean AIC improvements of 717.7 and 606.6 units over conventional Gaussian mixture benchmarks for the two- and three-component scenarios respectively, with the heterogeneous model achieving superior fit in all 500 replications in both scenarios. These results provide strong empirical evidence that cross-family heterogeneity in mixture components offers substantial and consistent gains in model fit for engineering data with structurally complex generating processes. Future research should extend the framework to censored lifetime data, formalize component family selection procedures, and investigate Bayesian estimation alternatives.

Özet

Mixture distribution models have become indispensable tools for characterizing complex, non-Gaussian data structures that frequently arise in engineering and reliability contexts. However, existing mixture frameworks predominantly assume homogeneous component families, typically Gaussian, which limits their capacity to represent data generated by fundamentally different physical mechanisms. This paper presents a formal theoretical framework for heterogeneous mixture distributions, in which component densities are drawn from distinct parametric families — specifically the Normal, Gamma, Weibull, and Lognormal distributions — with identifiability conditions formally established across the full family set. A unified parameter estimation strategy based on maximum likelihood and the Expectation-Maximization (EM) algorithm is developed, accommodating cross-family heterogeneity within a single iterative procedure. The framework is evaluated through a Monte Carlo simulation study comprising B = 500 independent replications with n = 2000 observations per replication, under two engineering-motivated scenarios: a two-component heterogeneous mixture (Weibull–Normal) designed to reflect early-failure and steady-state behavior, and a three-component mixture (Weibull–Normal–Lognormal) representing a full bathtub-curve reliability profile. Model performance is assessed using the Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC). The proposed heterogeneous models yield mean AIC improvements of 717.7 and 606.6 units over conventional Gaussian mixture benchmarks for the two- and three-component scenarios respectively, with the heterogeneous model achieving superior fit in all 500 replications in both scenarios. These results provide strong empirical evidence that cross-family heterogeneity in mixture components offers substantial and consistent gains in model fit for engineering data with structurally complex generating processes. Future research should extend the framework to censored lifetime data, formalize component family selection procedures, and investigate Bayesian estimation alternatives.

🔖

Cite This Article

Güleryüz, S. S. (2026). Heterogeneous Mixture Distributions for Modeling Skewed Data in Engineering Applications: A Theoretical Approach. Black Sea Journal of Engineering and Science, Cilt: 9 Sayı: 5, 2249–2258. https://doi.org/10.34248/bsengineering.1977966

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (39)

  1. Abernethy, R. B. (2006). The new Weibull handbook: Reliability and statistical analysis for predicting life, safety, supportability, risk, cost and warranty claims (5th ed.).
  2. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723. https://doi.org/10.1109/TAC.1974.1100705
  3. Berk, R. H. (1966). Limiting behavior of posterior distributions when the model is incorrect. The Annals of Mathematical Statistics, 37(1), 51–58. https://doi.org/10.1214/aoms/1177699597
  4. Bishop, C. M. (2006). Pattern recognition and machine learning. Springer.
  5. Burnham, K. P., & Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). Springer. https://doi.org/10.1007/b97636
  6. Celeux, G., & Govaert, G. (1995). Gaussian parsimonious clustering models. Pattern Recognition, 28(5), 781–793. https://doi.org/10.1016/0031-3203(94)00125-6
  7. Crow, L. H., & Shimizu, K. (Eds.). (1988). Lognormal distributions: Theory and applications. Marcel Dekker.
  8. Crowder, M. J., Kimber, A. C., Smith, R. L., & Sweeting, T. J. (1991). Statistical analysis of reliability data. Chapman & Hall.
  9. DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2(3), 292–307. https://doi.org/10.1037/1082-989X.2.3.292
  10. Delignette-Muller, M. L., & Dutang, C. (2015). fitdistrplus: An R package for fitting distributions. Journal of Statistical Software, 64(4), 1–34. https://doi.org/10.18637/jss.v064.i04
  11. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39(1), 1–38. https://doi.org/10.1111/j.2517-6161.1977.tb01600.x
  12. Ebeling, C. E. (2010). An introduction to reliability and maintainability engineering (2nd ed.). Waveland Press.
  13. Everitt, B. S., & Hand, D. J. (1981). Finite mixture distributions. Chapman & Hall.
  14. Fraley, C., & Raftery, A. E. (2002). Model-based clustering, discriminant analysis, and density estimation. Journal of the American Statistical Association, 97(458), 611–631. https://doi.org/10.1198/016214502760047131
  15. Frühwirth-Schnatter, S. (2006). Finite mixture and Markov switching models. Springer. https://doi.org/10.1007/978-0-387-35768-3
  16. Furman, E., & Landsman, Z. (2005). Risk capital decomposition for a multivariate dependent Gamma portfolio. Insurance: Mathematics and Economics, 37(3), 635–649. https://doi.org/10.1016/j.insmatheco.2005.06.006
  17. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage Learning.
  18. Jiang, R., & Murthy, D. N. P. (1995). Modeling failure-data by mixture of 2 Weibull distributions: A graphical approach. IEEE Transactions on Reliability, 44(3), 477–488. https://doi.org/10.1109/24.406588
  19. Jiang, R., & Murthy, D. N. P. (1998). Mixture of Weibull distributions — parametric characterization of failure rate function. Applied Stochastic Models and Data Analysis, 14(1), 47–65. https://doi.org/10.1002/(SICI)1099-0747(199803)14:1 3.0.CO;2-E
  20. Johnson, N. L., Kotz, S., & Balakrishnan, N. (1994). Continuous univariate distributions (2nd ed., Vol. 1). Wiley.
  21. Lawless, J. F. (2003). Statistical models and methods for lifetime data (2nd ed.). Wiley. https://doi.org/10.1002/9781118033005
  22. MathWorks. (2023). MATLAB (Version R2023b) [Computer software]. The MathWorks, Inc. https://www.mathworks.com
  23. McLachlan, G. J., & Krishnan, T. (2008). The EM algorithm and extensions (2nd ed.). Wiley. https://doi.org/10.1002/9780470191613
  24. McLachlan, G. J., & Peel, D. (2000). Finite mixture models. Wiley. https://doi.org/10.1002/0471721182
  25. Meeker, W. Q., Escobar, L. A., & Pascual, F. G. (2022). Statistical methods for reliability data (2nd ed.). Wiley.
  26. Murphy, K. P. (2012). Machine learning: A probabilistic perspective. MIT Press.
  27. Murthy, D. N. P., Xie, M., & Jiang, R. (2004). Weibull models. Wiley. https://doi.org/10.1002/047147326X
  28. Pearson, K. (1894). Contributions to the mathematical theory of evolution. Philosophical Transactions of the Royal Society of London A, 185, 71–110. https://doi.org/10.1098/rsta.1894.0003
  29. R Core Team. (2024). R: A language and environment for statistical computing [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/
  30. Reynolds, D. A. (2009). Gaussian mixture models. In S. Z. Li & A. K. Jain (Eds.), Encyclopedia of biometrics (pp. 659–663). Springer. https://doi.org/10.1007/978-0-387-73003-5_196
  31. Rinne, H. (2009). The Weibull distribution: A handbook. CRC Press.
  32. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461–464. https://doi.org/10.1214/aos/1176344136
  33. Teicher, H. (1963). Identifiability of finite mixtures. The Annals of Mathematical Statistics, 34(4), 1265–1269. https://doi.org/10.1214/aoms/1177703862
  34. Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1985). Statistical analysis of finite mixture distributions. Wiley.
  35. Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., van der Walt, S. J., Brett, M., Wilson, J., Millman, K. J., Mayorov, N., Nelson, A. R. J., Jones, E., Kern, R., Larson, E., … SciPy 1.0 Contributors. (2020). SciPy 1.0: Fundamental algorithms for scientific computing in Python. Nature Methods, 17(3), 261–272. https://doi.org/10.1038/s41592-020-0772-5
  36. Weibull, W. (1951). A statistical distribution function of wide applicability. Journal of Applied Mechanics, 18(3), 293–297. https://doi.org/10.1115/1.4010337
  37. White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica, 50(1), 1–25. https://doi.org/10.2307/1912526
  38. Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. Springer. https://doi.org/10.1007/978-3-319-24277-4
  39. Yakowitz, S. J., & Spragins, J. D. (1968). On the identifiability of finite mixtures. The Annals of Mathematical Statistics, 39(1), 209–214. https://doi.org/10.1214/aoms/1177698520