SavedAdd your journal

Journals / Computers and Informatics / 2021 / Cilt: 1 - Sayı: 1

Performance comparison of deep learning frameworks

M. Mutlu YAPICI
Nurettin TOPALOĞLU
Pages
1–11
Publication Date
2021-02-28
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

In this way, it is aimed to assist the researchers in choosing the most appropriate DL framework for their studies.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Deep learning (DL) is branch of machine learning and imitates the neural activity of brain on to artificial neural networks.
📊
Key Findings & Data:In this study, the most commonly used DL frameworks such as Torch, Theano, Caffe, Caffe2, MXNet, Keras, TensorFlow and Computational Network Tool Kit (CNTK) are investigated and performance comparison of the frameworks is provided. .
💡
Conclusion & Impact:In this way, it is aimed to assist the researchers in choosing the most appropriate DL framework for their studies.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Artificial neural network · Deep learning · Deep learning frameworks

Abstract

Deep learning (DL) is branch of machine learning and imitates the neural activity of brain on to artificial neural networks. Meanwhile it can be trained to define characteristics of data such as image, voice or different complex patterns. DL is capable of to find solutions for complex and NP-hard problems. In literature, there are many DL frameworks, libraries and tools to develop solutions. In this study, the most commonly used DL frameworks such as Torch, Theano, Caffe, Caffe2, MXNet, Keras, TensorFlow and Computational Network Tool Kit (CNTK) are investigated and performance comparison of the frameworks is provided. . In addition, the GPU performances have been tested for the best frameworks which have been determined according to the literature: TensorFlow, Keras (TensorFlow Backend), Theano, Keras (Theano Backend), Torch. The GPU performance comparison of these frameworks has been made by the experimental results obtained through MNIST and GPDS signature datasets. According to experimental results TensorFlow was detected best one, while other researches in the literature claimed that Pytorch is better. The contributions of in this study is to eliminate the contradiction in the literature by revealing the cause. In this way, it is aimed to assist the researchers in choosing the most appropriate DL framework for their studies.

🔖

Cite This Article

YAPICI, M. M., TOPALOĞLU, N. (2021). Performance comparison of deep learning frameworks. Computers and Informatics, Cilt: 1 - Sayı: 1, 1–11. https://ajindex.com/articles/748326

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (20)

  1. Bahrampour, S., Ramakrishnan, N., Schott, L., & Shah M., Comparative study of caffe, neon, theano, and torch for deep learning 2016, arXiv, abs/1511.06435
  2. Chen T., et al. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems, arXiv Prepr 2015. arXiv1512.01274
  3. Jia Y. et al. Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the 22nd ACM international conference on Multimedia 2014, 675–678
  4. NVIDIA. Caffe2 Deep Learning Framework 2017.
  5. Chollet F., et al. Keras: Deep learning library for theano and tensorflow 2015. URL https//keras. io/k, 7, 8. [6] ̧F.ois Chollet, Keras 2015,
  6. Microsoft. Computational Network Toolkit (CNTK) 2016. [Online]. Available:
  7. Huang. X., Microsoft computational network toolkit offers most efficient distributed deep learning computational performance 2015.
  8. Microsoft. The Microsoft Cognitive Toolkit 2016.
  9. Banerjee, D.S., Hamidouche, K., & Panda, D.K., Re-Designing CNTK Deep Learning Framework on Modern GPU Enabled Clusters, 2016 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), 2016, pp. 144–151, DOI: 10.1109/CloudCom.2016.0036
  10. MXNet. MXNet 2017.
  11. Google, TensorFlow. [Online]. Available:
  12. NVIDIA. GPU-Accelerated TensorFlow 2018.
  13. Abadi M., et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems 2016. arXiv Prepr. arXiv1603.04467, 2016
  14. Goldsborough. P., A tour of TensorFlow 2016. arXiv Prepr. arXiv1610.01178
  15. Comparing Top Deep Learning Frameworks.
  16. Bergstra J., et al. Theano: A CPU and GPU math compiler in Python 2010. In Proc. 9th Python in Science Conf, vol. 1
  17. Bastien F. et al. Theano: new features and speed improvements 2012. arXiv Prepr. arXiv1211.5590
  18. Al-Rfou R., et al. Theano: A Python framework for fast computation of mathematical expressions. arXiv Prepr. arXiv1605.02688, 472: 473-2016
  19. Torch. What is Torch? http://torch.ch/. [Online]. Available:
  20. Chetlur S., et al. Cudnn: Efficient primitive