KaydedilenlerDerginizi ekleyin

Dergiler / Computers and Informatics / 2021 / Cilt: 1 - Sayı: 1

Performance comparison of deep learning frameworks

M. Mutlu YAPICI
Nurettin TOPALOĞLU
Sayfa
1–11
Yayın Tarihi
2021-02-28
DOI
—
🏛️Bu makalenin bibliyografik verileri ve tam metin bağlantısı DergiPark üzerinden sağlanmıştır.
DergiPark Kaydı ↗
✨

Yapay Zeka Hızlı Bakış & Çıkarımlar

AI Insight
⚡ TL;DR(1 Cümlede Hızlı Çıkarım)

In this way, it is aimed to assist the researchers in choosing the most appropriate DL framework for their studies.

📌 3 Maddede Bu Makale

🎯
Amaç & Hipotez:Deep learning (DL) is branch of machine learning and imitates the neural activity of brain on to artificial neural networks.
📊
Temel Bulgular & Veri:In this study, the most commonly used DL frameworks such as Torch, Theano, Caffe, Caffe2, MXNet, Keras, TensorFlow and Computational Network Tool Kit (CNTK) are investigated and performance comparison of the frameworks is provided. .
💡
Sonuç & Katkı:In this way, it is aimed to assist the researchers in choosing the most appropriate DL framework for their studies.
🔬Tür:Modelleme & Sayısal Simülasyon
📍Kapsam:Genişletilmiş Akademik Örneklem
⚙️Değişkenler:Artificial neural network · Deep learning · Deep learning frameworks

Abstract

Deep learning (DL) is branch of machine learning and imitates the neural activity of brain on to artificial neural networks. Meanwhile it can be trained to define characteristics of data such as image, voice or different complex patterns. DL is capable of to find solutions for complex and NP-hard problems. In literature, there are many DL frameworks, libraries and tools to develop solutions. In this study, the most commonly used DL frameworks such as Torch, Theano, Caffe, Caffe2, MXNet, Keras, TensorFlow and Computational Network Tool Kit (CNTK) are investigated and performance comparison of the frameworks is provided. . In addition, the GPU performances have been tested for the best frameworks which have been determined according to the literature: TensorFlow, Keras (TensorFlow Backend), Theano, Keras (Theano Backend), Torch. The GPU performance comparison of these frameworks has been made by the experimental results obtained through MNIST and GPDS signature datasets. According to experimental results TensorFlow was detected best one, while other researches in the literature claimed that Pytorch is better. The contributions of in this study is to eliminate the contradiction in the literature by revealing the cause. In this way, it is aimed to assist the researchers in choosing the most appropriate DL framework for their studies.

🔖

Bu Makaleye Atıf Yap

YAPICI, M. M., TOPALOĞLU, N. (2021). Performance comparison of deep learning frameworks. Computers and Informatics, Cilt: 1 - Sayı: 1, 1–11. https://ajindex.com/articles/748326

📄 Tam Metin PDF Okuyucu

📄

PDF görüntüleyici hazırlanıyor...

Kaynakça (20)

  1. Bahrampour, S., Ramakrishnan, N., Schott, L., & Shah M., Comparative study of caffe, neon, theano, and torch for deep learning 2016, arXiv, abs/1511.06435
  2. Chen T., et al. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems, arXiv Prepr 2015. arXiv1512.01274
  3. Jia Y. et al. Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the 22nd ACM international conference on Multimedia 2014, 675–678
  4. NVIDIA. Caffe2 Deep Learning Framework 2017.
  5. Chollet F., et al. Keras: Deep learning library for theano and tensorflow 2015. URL https//keras. io/k, 7, 8. [6] ̧F.ois Chollet, Keras 2015,
  6. Microsoft. Computational Network Toolkit (CNTK) 2016. [Online]. Available:
  7. Huang. X., Microsoft computational network toolkit offers most efficient distributed deep learning computational performance 2015.
  8. Microsoft. The Microsoft Cognitive Toolkit 2016.
  9. Banerjee, D.S., Hamidouche, K., & Panda, D.K., Re-Designing CNTK Deep Learning Framework on Modern GPU Enabled Clusters, 2016 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), 2016, pp. 144–151, DOI: 10.1109/CloudCom.2016.0036
  10. MXNet. MXNet 2017.
  11. Google, TensorFlow. [Online]. Available:
  12. NVIDIA. GPU-Accelerated TensorFlow 2018.
  13. Abadi M., et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems 2016. arXiv Prepr. arXiv1603.04467, 2016
  14. Goldsborough. P., A tour of TensorFlow 2016. arXiv Prepr. arXiv1610.01178
  15. Comparing Top Deep Learning Frameworks.
  16. Bergstra J., et al. Theano: A CPU and GPU math compiler in Python 2010. In Proc. 9th Python in Science Conf, vol. 1
  17. Bastien F. et al. Theano: new features and speed improvements 2012. arXiv Prepr. arXiv1211.5590
  18. Al-Rfou R., et al. Theano: A Python framework for fast computation of mathematical expressions. arXiv Prepr. arXiv1605.02688, 472: 473-2016
  19. Torch. What is Torch? http://torch.ch/. [Online]. Available:
  20. Chetlur S., et al. Cudnn: Efficient primitive