KaydedilenlerDerginizi ekleyin

Dergiler / Electrica / 2021 / Cilt: 21 - Sayı: 3

A Stochastic Computing Method For Generating Activation Functions in Multilayer Feedforward Neural Networks

Burcu ERKMEN
Durmuş ERSOY
Sayfa
376–387
Yayın Tarihi
2022-10-12
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

The dataset used for the classification process in a decentralized smart grid control has been applied to the multilayer feedforward neural network and deterministic computing, for the stability classification which is carried out separately with the linear finite state machines-based stochastic computing and the proposed 2D finite state machines-based stochastic computing methods.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:Stochastic computing using basic arithmetic logic elements based on stochastic bit sequences provides very beneficial solutions in terms of speed and hardware cost, relative to deterministic calculation.
📊
Temel Bulgular & Veri:In this analysis, in terms of both error rate and circuit cost, the advantageous two-dimensional finite state machines-based stochastic computing approach for tangent hyperbolic and exponential functions is presented.
💡
Sonuç & Katkı:The dataset used for the classification process in a decentralized smart grid control has been applied to the multilayer feedforward neural network and deterministic computing, for the stability classification which is carried out separately with the linear finite state machines-based stochastic computing and the proposed 2D finite state machines-based stochastic computing methods.
🔬Tür:Araştırma Makalesi
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Alan Parametreleri

Abstract

Stochastic computing using basic arithmetic logic elements based on stochastic bit sequences provides very beneficial solutions in terms of speed and hardware cost, relative to deterministic calculation. Studies for the realization of tangent hyperbolic and exponential functions used in the development of activation functions in Artificial Neural Networks by stochastic methods exist in the literature. The techniques presented using state transitions on finite state machines were constructed on the basis of two different forms of finite state machines, one-dimensional (Linear) and two-dimensional. In this analysis, in terms of both error rate and circuit cost, the advantageous two-dimensional finite state machines-based stochastic computing approach for tangent hyperbolic and exponential functions is presented. The presented approach is implemented on Field Programmable Gate Array and the results are given for hardware simulation. The dataset used for the classification process in a decentralized smart grid control has been applied to the multilayer feedforward neural network and deterministic computing, for the stability classification which is carried out separately with the linear finite state machines-based stochastic computing and the proposed 2D finite state machines-based stochastic computing methods.

🔖

Bu Makaleye Atıf Yap

ERKMEN, B., ERSOY, D. (2022). A Stochastic Computing Method For Generating Activation Functions in Multilayer Feedforward Neural Networks. Electrica, Cilt: 21 - Sayı: 3, 376–387. https://ajindex.com/articles/499915

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (12)

  1. J. Li, A. Ren, Z. Li, C. Ding, B. Yuan, Q. Qiu, and Y. Wang. “Towards acceleration of deep convolutional neural networks using stochastic computing,” 22nd Asia and South Pacific Design Automation Conference (ASP-DAC), pp. 115–120, Jan. 2017
  2. B. R. Gaines, “Stochastic computing systems,” Advances in Information Systems Science. Tou J.T. (eds) Boston, MA: Springer, 1969, pp. 37–172
  3. P. Li and D. J. Lilja, “Using stochastic computing to implement digital image processing algorithms” 29th International Conference on Computer Design (ICCD), pp. 154–161, October 2011
  4. P. Li, D. J. Lilja, W. Qian, K. Bazargan and M. D. Riedel, “Computation on stochastic bit streams digital image processing case studies,” IEEE Transactions on Very Large Scale Integration (VLSI) Systems, vol. 22, no. 3, pp. 449–462, April 2013
  5. X. Zeng and J. Wang, “A parallel hybrid electric vehicle energy management strategy using stochastic model predictive control with road grade preview,” IEEE Transactions on Control Systems Technology, vol. 23, no. 6, pp. 2416–2423, Nov. 2015
  6. J. Zheng, Y. Cai, Y. Wu and X. Shen, “Dynamic computation offloading for mobile cloud computing: A stochastic game-theoretic approach,” IEEE Transactions on Mobile Computing, vol. 18, no. 4, pp. 771–786, June 2018
  7. G. Arslan and S. Yüksel, “Decentralized Q-learning for stochastic teams and games,” IEEE Transactions on Automatic Control, vol. 62, no. 4, pp. 1545–1558, Aug. 2016
  8. B. Li, Y. Qin, B. Yuan and D. J. Lilja, “Neural network classifiers using stochastic computing with a hardware-oriented approximate activation function,” IEEE International Conference on Computer Design (ICCD), vol. 66, no. 7, pp. 97 –104, Nov. 2017
  9. S. Liu, H. Jiang, L. Liu and J. Han, “Gradient descent using stochastic circuits for efficient training of learning machines,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol. 37, no. 11, pp. 2530–2541, Oct. 2018
  10. Y. Liu, S. Liu, Y. Wang, F. Lombardi and J. Han, “A stochastic computational multi-layer perceptron with backward propagation,” IEEE Transactions on Computers, vol. 67, no. 9, pp. 1273–1286, March 2018
  11. J. Yu, K. Kim, J. Lee and K. Choi, “Accurate and efficient stochastic computing hardware for convolutional neural networks,” IEEE International Conference on Computer Design (ICCD), pp. 105–112, Nov. 2017
  12. Z. Li, J. Li, A. Ren, C. Ding, J. Draper, Q. Qiu, B. Yuan, and Y. Wang, “Towards budget-driven hardware optimizati