Journals / Afyon Kocatepe Üniversitesi Fen ve Mühendislik Bilimleri Dergisi / 2021 / Cilt: 21 - Sayı: 6

Contribution Analysis of Optimization Methods on Super-Resolution

Optimizasyon Yöntemlerinin Süper Çözünürlük Üzerine Katkı Analizi

Pages
1343–1352
Publication Date
2022-10-12
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

These results show that selected optimization function for the CNN model plays an important role in increasing the accuracy rate in the super-resolution problem.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:In this study, the benefits of choosing a robust optimization function with super resolution are analyzed.
📊
Key Findings & Data:For this purpose, the different optimizers are included in the simple Convolutional Neural Network (CNN) architecture SRNET, to reveal the performance of the each method.
💡
Conclusion & Impact:These results show that selected optimization function for the CNN model plays an important role in increasing the accuracy rate in the super-resolution problem.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Domain Parameters

Abstract

In this study, the benefits of choosing a robust optimization function with super resolution are analyzed. For this purpose, the different optimizers are included in the simple Convolutional Neural Network (CNN) architecture SRNET, to reveal the performance of the each method. Findings of this research provides that Adam and Nadam optimizers are robust when compared to (Stochastic Gradient Descent) SGD, Adagrad, Adamax and RMSprop. After experimental simulations, we have achieved the 35.91 (dB)/0.9960 and 35.97 (dB)/0.9961 accuracy rates on Set5 images from Adam and Nadam optimizers, respectively (9-1-5 network structure and filter sizes 128 and 64). These results show that selected optimization function for the CNN model plays an important role in increasing the accuracy rate in the super-resolution problem.

Özet

Bu çalışmada, süper çözünürlükte sağlam bir optimizasyon fonksiyonu seçmenin yararları analiz edilmiştir. Bu amaçla her yöntemin performansını ortaya çıkarmak için farklı optimize ediciler, basit Evrişimsel Sinir Ağı (CNN) mimarisi SRNET' e dahil edilmiştir. Bu araştırmanın bulguları, Adam ve Nadam optimize edicilerin Stokastik Gradyan İnişi (SGD), Adagrad, Adamax ve RMSprop ile karşılaştırıldığında daha kararlı olduğunu göstermektedir. Deneysel simülasyonlardan sonra, Adam ve Nadam optimize edicilerinden Set5 görüntülerinde sırasıyla 35.91 (dB)/0.9960 ve 35.97 (dB)/0.9961 doğruluk oranlarına ulaştık (9-1-5 ağ yapısı ve filtre boyutları 128 ve 64). Bu sonuçlar, CNN modeli için seçilen optimizasyon fonksiyonunun süper çözünürlük probleminde doğruluk oranını arttırmada önemli bir rol oynadığını göstermektedir.

🔖

Cite This Article

IŞIK, Ş., ANAGÜN, Y. (2022). Contribution Analysis of Optimization Methods on Super-Resolution. Afyon Kocatepe Üniversitesi Fen ve Mühendislik Bilimleri Dergisi, Cilt: 21 - Sayı: 6, 1343–1352. https://ajindex.com/articles/429617

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (8)

  1. Anagun, Y., Isik, S. and Seke, E., (2019). SRLibrary: Comparing different loss functions for super-resolution over various convolutional architectures. Journal of Visual Communication and Image Representation, 61, 178-187.
  2. Anagün, Y., (2018). Düşük çözünürlüklü video sahnelerinden yüksek çözünürlüklü video sahnelerinin elde edilmesi. Doktora Tezi, Fen Bilimleri Enstitüsü Elektrik ve Elektronik Mühendisliği Anabilim Dalı, Eskişehir, 75. Bevilacqua, M., Cunningham, A., Guillemot, C., et al., (2012). Low-complexity single-image super-resolution based on nonnegative neighbor embedding. Dong, C., Loy, C. C., He, K., et al., (2015). Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38 (2), 295-307.
  3. Dong, C., Loy, C. C. and Tang, X. (2016). Accelerating the Super-Resolution Convolutional Neural Network, European Conference on Computer Vision (ECCV). Dong, W., Zhang, L., Lukac, R., et al., (2013). Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Trans. Image Process, 22 (4), 1382-1394.
  4. Dozat, T. (2016). Incorporating nesterov momentum into adam, ICLR Workshop, (1):2013–2016.
  5. Duchi, J., Hazan, E. and Singer, Y., (2011). Adaptive subgradient methods for online learning and stochastic optimization. 12 (7). Gao, X., Zhang, K. and Tao, D., (2012). Image Super-Resolution With Sparse Neighbor Embedding. IEEE Trans. Image Process, 21 (7), 3194-3205.
  6. He, K., Zhang, X., Ren, S., et al. (2016). Deep residual learning for image recognition, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA. Kaveh, A. and Ezzatollah, S., (2017). Single-image super resolution using evolutionary sparse coding technique’. IET Image Process., 11 (1), 13-21.
  7. Kim, J., Lee, J. K. and Lee, K. M. (2016). Accurate image super-resolution using very deep convolutional networks, in IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA. Kingma, D. P. and Ba, J., (2014). Adam: A method for stochastic optimization. Lai, W. S., Huang, J. B., Ahuja, N., et al., (2018). Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41 (11), 2599-2613.
  8. Ledig, C., Theis, L., Husz´ar, F., et al. (2017). Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).