SavedAdd your journal

Journals / International Journal of Intelligent Systems and Applications in Engineering / 2018 / Cilt: 6 - Sayı: 4

Improved Nelder-Mead Optimization Method in Learning Phase of Artificial Neural Networks

HASAN ERDİNÇ KOÇER
Mustafa MERDAN
Mohammed Hussein IBRAHIM
Pages
271–274
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

As a result of this comparison, the proposed improved Nelder-Mead-Artificial neural networks classification algorithm has given best results in all datasets.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Artificial neural networks method is the most important/preferred classification algorithm in machine learning area.
📊
Key Findings & Data:The performance of the proposed improved Nelder-Mead-Artificial neural networks classification algorithm has been tested on the most common datasets from the UCI machine learning repository.
💡
Conclusion & Impact:As a result of this comparison, the proposed improved Nelder-Mead-Artificial neural networks classification algorithm has given best results in all datasets.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Özet

Artificial neural networks method is the most important/preferred classification algorithm in machine learning area. The weights on the nets in artificial neural directly affect the classification accuracy of artificial neural networks. Therefore, finding optimum values of these weights is a difficult optimization problem. In this study, the Nelder-Mead optimization method has been improved and used for training of artificial neural networks. The optimum weights of artificial neural networks are determined in the training stage. The performance of the proposed improved Nelder-Mead-Artificial neural networks classification algorithm has been tested on the most common datasets from the UCI machine learning repository. The classification results obtained from the proposed improved Nelder-Mead- Artificial neural networks classification algorithm are compared with the results of the standard Nelder-Mead-Artificial neural networks classification algorithm. As a result of this comparison, the proposed improved Nelder-Mead-Artificial neural networks classification algorithm has given best results in all datasets.

🔖

Cite This Article

KOÇER, H. E., MERDAN, M., IBRAHIM, M. H. (2018). Improved Nelder-Mead Optimization Method in Learning Phase of Artificial Neural Networks. International Journal of Intelligent Systems and Applications in Engineering, Cilt: 6 - Sayı: 4, 271–274. https://ajindex.com/articles/162390

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (11)

  1. APA Kecman, V. (2001). Learning and soft computing: support vector machines, neural networks, and fuzzy logic models. MIT press. Alhamdoosh, M., & Wang, D. (2014). Fast decorrelated neural network ensembles with random weights. Information Sciences, 264, 104-117.
  2. Slowik, A. (2011). Application of an adaptive differential evolution algorithm with multiple trial vectors to artificial neural network training. IEEE Transactions on Industrial Electronics, 58(8), 3160- 3167. Mohaghegi, S., del Valle, Y., Venayagamoorthy, G. K., & Harley, R. G. (2005, June). A comparison of PSO and backpropagation for training RBF neural networks for identification of a power system with STATCOM. In Swarm Intelligence Symposium, 2005. SIS 2005. Proceedings 2005 IEEE (pp. 381-384).
  3. Montana, D. J., & Davis, L. (1989, August). Training Feedforward Neural Networks Using Genetic Algorithms. In IJCAI (Vol. 89, pp. 762-767).
  4. Malinak, P., &Jaksa, R. (2007, September). Simultaneous gradient and evolutionary neural network weights adaptation methods. In Evolutionary Computation, 2007. CEC 2007. IEEE Congress on (pp. 2665-2671).
  5. IEEE. Kennedy, J. (2011). Particle swarm optimization. In Encyclopedia of machine learning (pp. 760-766).
  6. Springer US. Carvalho, M., &Ludermir, T. B. (2007, September). Particle swarm optimization of neural network architectures and weights. In Hybrid Intelligent Systems, 2007. HIS 2007. 7th International Conference on (pp. 336-339).
  7. IEEE. Dorigo, M., Birattari, M., &Stutzle, T. (2006). Ant colony optimization. IEEE computational intelligence magazine, 1(4), 28-39.
  8. Hu, Liang, et al. "Optimization of neural network by genetic algorithm for flowrate determination in multipath ultrasonic gas flowmeter." IEEE Sensors Journal 16.5 (2016): 1158-1167.
  9. Kapanova, K. G., Dimov, I., &Sellier, J. M. A genetic approach to automatic neural network architecture optimization. Neural Computing and Applications, 1-12.
  10. Han, J., Pei, J., &Kamber, M. (2011). Data mining: concepts and techniques. Elsevier. Schalkoff, R. J. (1997). Artificial neural networks (Vol. 1). New York: McGraw-Hill. Kelley, C. T. (1999). Detection and remediation of stagnation in the nelder-mead algorithm using a sufficient decrease condition. SIAM journal on optimization, 10(1), 43-55.
  11. Lagarias J. C., J. A. Reeds, M. H. Wright, and P. E. Wright, 1998. Convergence properties of the Nelder-Mead simplex method in low dimensions. SIAM Journal on Optimization, 9(1), p. 112- 147. Asuncion, A., & Newman, D. (2007). UCI