Journals / Gazi University Journal of Science / 2022 / Cilt: 35 - Sayı: 2

An Efficient Hybrid Algorithm with Particle Swarm Optimization and Nelder-Mead Algorithm for Parameter Estimation of Nonlinear Regression Modeling

Pages
716–729
Publication Date
2022-11-09
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

The experimental results indicated that the suggested hybrid algorithm provides accurate estimates, and its performance is much superior to those of NM and PSO algorithms.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Nonlinear regression analysis is an important statistical method widely used in many fields of science to model the complex relationships between variables.
📊
Key Findings & Data:To show the performance of the proposed hybrid algorithm, 20 nonlinear regression tasks with various levels of difficulty, and real data sets in the agriculture field have been tested.
💡
Conclusion & Impact:The experimental results indicated that the suggested hybrid algorithm provides accurate estimates, and its performance is much superior to those of NM and PSO algorithms.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Nelder-Mead algorithm · Particle swarm optimization · Nonlinear regression

Abstract

Nonlinear regression analysis is an important statistical method widely used in many fields of science to model the complex relationships between variables. Therefore, many studies have been conducted to estimate the parameters of nonlinear regression models using various iterative techniques. In this study, an efficient hybrid algorithm, namely PSONM, by combining the exploration capability of Particle Swarm Optimization (PSO) and the exploitation capability of the Nelder-Mead (NM) algorithm is proposed to obtain parameter estimates of nonlinear regression models. To show the performance of the proposed hybrid algorithm, 20 nonlinear regression tasks with various levels of difficulty, and real data sets in the agriculture field have been tested. The experimental results indicated that the suggested hybrid algorithm provides accurate estimates, and its performance is much superior to those of NM and PSO algorithms.

🔖

Cite This Article

YONAR, A., YONAR, H. (2022). An Efficient Hybrid Algorithm with Particle Swarm Optimization and Nelder-Mead Algorithm for Parameter Estimation of Nonlinear Regression Modeling. Gazi University Journal of Science, Cilt: 35 - Sayı: 2, 716–729. https://ajindex.com/articles/648851

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (13)

  1. Nash, J.C. and Walker-Smith, M., Nonlinear parameter estimation: An integrated system on BASIC. Marcel Dekker, New York, (1987)
  2. Křivý, I. and Tvrdík, J., Krpec, R., “Stochastic algorithms in nonlinear regression”, Computational Statistics Data Analysis, 33(3): 277–290, (2000)
  3. Yonar, A., Yapıcı Pehlivan, N., “A novel differential evolution algorithm approach for estimating the parameters of Gamma distribution: An application to the failure stresses of single carbon fibres”, Hacettepe Journal of Mathematics and Statistics, 49(4): 1493–1514, (2020)
  4. De los Cobos Silva, S.G., Andrade, M.Á.G., García, E.A.R., Velázquez, P.L., Cornejo, M.A., “Estimación de parámetros de regresión no lineal mediante colonia de abejas artificiales”, Revista de Matemática: Teoría y Aplicaciones, 20(1): 49–60, (2013)
  5. Tvrdík, J., “Adaptation in differential evolution: A numerical comparison”, Applied Soft Computing, 9(3): 1149–1155, (2009)
  6. Kapanoğlu, M., Ozan Koc I., and Erdogmus, S., “Genetic algorithms in parameter estimation for nonlinear regression models: an experimental approach”, Journal of Statistical Computation Simulation, 77(10): 851–867, (2007)
  7. Chen, J., “A New Hybrid Genetic Algorithm for Parameter Estimation of Nonlinear Regression Modeling”, Proceedings of the 15th International Conference on Man–Machine–Environment System Engineering, 261–266, (2015)
  8. Altunkaynak, B. and Alptekin, E., “The genetic algorithm method for parameter estimation in nonlinear regression”, Gazi University Journal of Science, 17(2): 43–51, (2004)
  9. Karr, C.L., Weck, B., Massart, D.-L., and Vankeerberghen, P., “Least median squares curve fitting using a genetic algorithm”, Engineering Applications of Artificial Intelligence 8(2): 177–189, (1995)
  10. De-los-Cobos-Silva, S., Terceño-Gómez, A., Gutiérrez-Andrade, M., Rincón-García, E., Lara-Velázquez, P., Aguilar-Cornejo, M., “Particle Swarm Optimization: An Alternative for Parameter Estimation in Regression”, Fuzzy Economic Review, 18(2): (2013)
  11. Cheng, S., Zhao, C., Wu, J., Shi, Y., “Particle swarm optimization in regression analysis: a case study”, International Conference in Swarm Intelligence, 55–63, (2013)
  12. Schwaab, M., Biscaia Jr, E.C., Monteiro, J.L., and Pinto, J.C., “Nonlinear parameter estimation through particle swarm optimization”, Chemical Engineering Science, 63(6): 1542–1552, (2008)
  13. Özsoy, V.S., Örkçü, H.H., “Estimating the Parameters of Nonlinear Regression Models Through Pa