Journals / Balkan Journal of Electrical and Computer Engineering / 2022 / Cilt: 10 - Sayı: 1

Hybrid 3D Convolution and 2D Depthwise Separable Convolution Neural Network for Hyperspectral Image Classification

Pages
35–46
Publication Date
2022-01-30
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Extensive applications on frequently used HSI benchmark datasets show that the classification performance of the proposed network is better than compared methods.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Convolutional neural networks (CNNs) are one of the popular deep learning methods used to solve the hyperspectral image classification (HSIC) problem.
📊
Key Findings & Data:The traditional CNN-based methods mainly use the 2D CNN for HSIC.
💡
Conclusion & Impact:Extensive applications on frequently used HSI benchmark datasets show that the classification performance of the proposed network is better than compared methods.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:3D Convolutional Neural Network · Depthwise Separable Convolution · Deep Learning

Abstract

Convolutional neural networks (CNNs) are one of the popular deep learning methods used to solve the hyperspectral image classification (HSIC) problem. CNN has a strong feature learning ability that can ensure more distinctive features for higher quality HSIC. The traditional CNN-based methods mainly use the 2D CNN for HSIC. However, with 2D CNN, only spatial features are extracted in HSI. Good feature maps cannot be extracted from spectral dimensions with the use of 2D CNN alone. By using 3D CNN, spatial-spectral features are extracted simultaneously. However, 3D CNN is computationally complex. In this study, a hybrid CNN method, which is a combination of 3D CNN and 2D CNN, is improved to solve the two problems described above. Using hybrid CNN decreases the complexity of the method compared to using only 3D CNN and can perform well against a limited number of training samples. On the other hand, in Hybrid CNN, depthwise separable convolution (DSC) is used, which decreases computational cost, prevents overfitting and enables more spatial feature extraction. By adding DSC to the developed hybrid CNN, a hybrid depthwise separable convolutional neural network is obtained. Extensive applications on frequently used HSI benchmark datasets show that the classification performance of the proposed network is better than compared methods.

🔖

Cite This Article

FIRAT, H., ASKER, M. E., HANBAY, D. (2022). Hybrid 3D Convolution and 2D Depthwise Separable Convolution Neural Network for Hyperspectral Image Classification. Balkan Journal of Electrical and Computer Engineering, Cilt: 10 - Sayı: 1, 35–46. https://ajindex.com/articles/473198

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (11)

  1. H. Gao, Y. Yang, C. Li, L. Gao, and B. Zhang, “Multiscale Residual Network with Mixed Depthwise Convolution for Hyperspectral Image Classification,” IEEE Trans. Geosci. Remote Sens., vol. 59, no. 4, pp. 3396–3408, 2021, doi: 10.1109/TGRS.2020.3008286
  2. H. Fırat and D. Hanbay, “4CF-Net: Hiperspektral uzaktan algılama görüntülerinin spektral uzamsal sınıflandırılması için yeni 3B evrişimli sinir ağı,” Gazi Üniversitesi Mühendislik-Mimarlık Fakültesi Derg., vol. 1, pp. 439–453, 2021, doi: 10.17341/gazimmfd.901291
  3. H. Firat, M. Uçan, and D. Hanbay, “Hyperspectral Image Classification Using MiniVGGNet,” J. Comput. Sci., vol. IDAP-2021, no. Special, pp. 295–303, 2021
  4. H. Firat and D. Hanbay, “3B ESA Tabanlı ResNet50 Kullanılarak Hiperspektral Görüntülerin Sınıflandırılması Classification of Hyperspectral Images Using 3D CNN Based ResNet50,” 2021 29th Signal Process. Commun. Appl. Conf., pp. 6–9, 2021, doi: 10.1109/SIU53274.2021.9477899
  5. H. Firat, M. Uçan, and D. Hanbay, “Classification of Hyperspectral Remote Sensing Images Using Hybrid 3D-2D CNN Architecture,” J. Comput. Sci., vol. IDAP-2021, no. Special, pp. 132–140, 2021
  6. Y. Wang, W. Yu, and Z. Fang, “Multiple Kernel-based SVM classification of hyperspectral images by combining spectral, spatial, and semantic information,” Remote Sens., vol. 12, no. 1, 2020, doi: 10.3390/RS12010120
  7. M. Ahmad et al., “Spatial prior fuzziness pool-based interactive classification of hyperspectral images,” Remote Sens., vol. 11, no. 9, pp. 1–19, 2019, doi: 10.3390/rs11091136
  8. A. Alcolea, M. E. Paoletti, J. M. Haut, J. Resano, and A. Plaza, “Inference in supervised spectral classifiers for on-board hyperspectral imaging: An overview,” Remote Sens., vol. 12, no. 3, pp. 1–29, 2020, doi: 10.3390/rs12030534
  9. J. S. Ham, Y. Chen, M. M. Crawford, and J. Ghosh, “Investigation of the random forest framework for classification of hyperspectral data,” IEEE Trans. Geosci. Remote Sens., vol. 43, no. 3, pp. 492–501, 2005, doi: 10.1109/TGRS.2004.842481
  10. S. Ghaderizadeh, D. Abbasi-Moghadam, A. Sharifi, N. Zhao, and A. Tariq, “Hyperspectral Image Classification Using a Hybrid 3D-2D Convolutional Neural Networks,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., vol. 14, pp. 7570–7588, 2021, doi: 10.1109/JSTARS.2021.3099118
  11. M. F. Özdemir and D. Hanbay, “Comparison of Optimization Algorithms for Multi-Object Tracking FairMOT Algorithm,” J. Comput. Sci., vol. IDAP-2021, no. Special, pp. 147–153, 2021. [1