Journals / Natural and Engineering Sciences / 2024 / Volume: 9 Issue: 3

A Deep Learning-based Intelligent Automatic Detection and Classification of Fish Species in Marine Environment

Pages
—
Publication Date
2024-12-31
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

It has been observed that VT surpassed the prevailing literature by attaining 99.14% accuracy in efficient FSC.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:As marine environments encounter escalating threats and obstacles, accurate and effective Fish Species Classification (FSC) has become crucial for managing fisheries, preserving biodiversity, and ecological surveillance.
📊
Key Findings & Data:Considering the substantial volume of georeferenced fish photographs gathered daily by fishermen, artificial intelligence (AI) and computer vision (CV) technologies provide significant potential to automate their analysis via species recognition and classification.
💡
Conclusion & Impact:It has been observed that VT surpassed the prevailing literature by attaining 99.14% accuracy in efficient FSC.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Deep learning · vision transformer · fish species classification

Abstract

As marine environments encounter escalating threats and obstacles, accurate and effective Fish Species Classification (FSC) has become crucial for managing fisheries, preserving biodiversity, and ecological surveillance. Considering the substantial volume of georeferenced fish photographs gathered daily by fishermen, artificial intelligence (AI) and computer vision (CV) technologies provide significant potential to automate their analysis via species recognition and classification. This study investigates utilizing Deep Learning (DL) techniques alongside appearance-based feature selection to automatically and precisely determine fish species from images. The research utilizes many aquatic fish images, including diverse species, sizes, and ecological settings. Conventional DL models struggle to capture long-term dependencies and necessitate fixed input sizes, rendering them less adaptable when processing images of varying dimensions. The Vision Transformer (VT) mitigates these limitations using the transformer model's Self-Attention Mechanisms (SAM). This paper employs a VT to address the FSC problem and provides Intelligent Automatic Detection and FSC in Marine Environment (IAD-FSC-ME). VT's efficacy is evaluated compared to pre-trained Convolutional Neural Network (CNN) models: VGG19, DenseNet121, ResNet50v2, InceptionV3, and Xception. The investigations utilize an open data set (Fish4Knowledge), wherein both the object detection and classification systems are enhanced with subtropical fish species of interest. It has been observed that VT surpassed the prevailing literature by attaining 99.14% accuracy in efficient FSC.

🔖

Cite This Article

Nayak, A., F, R. (2024). A Deep Learning-based Intelligent Automatic Detection and Classification of Fish Species in Marine Environment. Natural and Engineering Sciences, Volume: 9 Issue: 3. https://doi.org/10.28978/nesciences.1606623

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (30)

  1. Agnes Pravina, X., Radhika, R., & Ramesh Palappan, R. (2024). Financial Inclusiveness and Literacy Awareness of Fisherfolk in Kanyakumari District: An Empirical Study. Indian Journal of Information Sources and Services, 14(3), 265–269. https://doi.org/10.51983/ijiss-2024.14.3.34
  2. Ahmed, I.M. (2024). Optimum Design of Reinforced Concrete Beams with Large Opening Using Neural Network Algorithm. International Academic Journal of Science and Engineering, 11(1), 138-152. http://doi.org/10.9756/IAJSE/V11I1/IAJSE1117
  3. Freire, K. M. F., Belhabib, D., Espedido, J. C., Hood, L., Kleisner, K. M., Lam, V. W.,. & Pauly, D. (2020). Estimating global catches of marine recreational fisheries. Frontiers in Marine Science, 7, 12. https://doi.org/10.3389/fmars.2020.00012
  4. Han, K., Wang, Y., Chen, H., Chen, X., Guo, J., Liu, Z.,. & Tao, D. (2022). A survey on vision transformer. IEEE transactions on pattern analysis and machine intelligence, 45(1), 87-110. https://doi.org/10.1109/TPAMI.2022.3152247
  5. Harris, D., Johnston, D., & Yeoh, D. (2021). More for less: Citizen science supporting the management of small-scale recreational fisheries. Regional Studies in Marine Science, 48, 102047. https://doi.org/10.1016/j.rsma.2021.102047
  6. Honarmand Ebrahimi, S., Ossewaarde, M., & Need, A. (2021). Smart fishery: a systematic review and research agenda for sustainable fisheries in the age of AI. Sustainability, 13(11), 6037. https://doi.org/10.3390/su13116037
  7. Hyder, K., Maravelias, C. D., Kraan, M., Radford, Z., & Prellezo, R. (2020). Marine recreational fisheries—current state and future opportunities. ICES Journal of Marine Science, 77(6), 2171-2180. https://doi.org/10.1093/icesjms/fsaa147
  8. Iqbal, M. A., Wang, Z., Ali, Z. A., & Riaz, S. (2021). Automatic fish species classification using deep convolutional neural networks. Wireless Personal Communications, 116, 1043-1053. https://doi.org/10.1007/s11277-019-06634-1
  9. Jahanbakht, M., Xiang, W., Waltham, N. J., & Azghadi, M. R. (2022). Distributed deep learning and energy-efficient real-time image processing at the edge for fish segmentation in underwater videos. IEEE Access, 10, 117796-117807. https://doi.org/10.1109/ACCESS.2022.3202975
  10. Kim, K., Ko, E., Kim, J., & Yi, J. H. (2019). Intelligent Malware Detection Based on Hybrid Learning of API and ACG on Android. Journal of Internet Services and Information Security, 9(4), 39-48. https://doi.org/10.22667/JISIS.2019.11.30.039
  11. Larkin, K. E., Marsan, A. A., Tonné, N., Van Isacker, N., Collart, T., Delaney, C.,. & Calewaert, J. B. (2022). Connecting marine data to society. In Ocean Science Data (pp. 283-317). Elsevier. https://doi.org/10.1016/B978-0-12-823427-3.00003-7
  12. Lekunberri, X., Ruiz, J., Quincoces, I., Dornaika, F., Arganda-Carreras, I., & Fernandes, J. A. (2022). Identification and measurement of tropical tuna species in purse seiner catches using computer vision and deep learning. Ecological Informatics, 67, 101495. https://doi.org/10.1016/j.ecoinf.2021.101495
  13. Li, S., Li, P., He, S., Kuai, Z., Gu, Y., Liu, H.,. & Lin, Y. (2024). An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN). Journal of Marine Science and Engineering, 12(8), 1343. https://doi.org/10.3390/jmse12081343
  14. Liu, S., Li, X., Gao, M., Cai, Y., Nian, R., Li, P.,. & Lendasse, A. (2018, October). Embedded online fish detection and tracking system via YOLOv3 and parallel correlation filter. In Oceans 2018 Mts/Ieee Charleston (pp. 1-6). IEEE. https://doi.org/10.1109/OCEANS.2018.8604658
  15. Pedersen, M., Bruslund Haurum, J., Gade, R., & Moeslund, T. B. (2019). Detection of marine animals in a new underwater dataset with varying visibility. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (pp. 18-26).
  16. Qu, H., Wang, G. G., Li, Y., Qi, X., & Zhang, M. (2024). ConvFishNet: An efficient backbone for fish classification from composited underwater images. Information Sciences, 121078. https://doi.org/10.1016/j.ins.2024.121078
  17. Scherrer, K., & Galbraith, E. (2020). Regulation strength and technology creep play key roles in global long-term projections of wild capture fisheries. ICES Journal of Marine Science, 77(7-8), 2518-2528. https://doi.org/10.1093/icesjms/fsaa109
  18. Silva, C. N., Dainys, J., Simmons, S., Vienožinskis, V., & Audzijonyte, A. (2022). A scalable open-source framework for machine learning-based image collection, annotation and classification: a case study for automatic fish species identification. Sustainability, 14(21), 14324. https://doi.org/10.3390/su142114324
  19. Teng, B., & Zhao, H. (2020). Underwater target recognition methods based on the framework of deep learning: A survey. International Journal of Advanced Robotic Systems, 17(6), 1729881420976307. https://doi.org/10.1177/1729881420976307
  20. Trivedi, J., Devi, M. S., & Solanki, B. (2023). Step Towards Intelligent Transportation System with Vehicle Classification and Recognition Using Speeded-up Robust Features. Archives for Technical Sciences, 1(28), 39-56. https://doi.org/10.59456/afts.2023.1528.039J
  21. Uyan, A. (2022). A Review on the Potential Usage of Lionfishes (Pterois spp.) in Biomedical and Bioinspired Applications. Natural and Engineering Sciences, 7(2), 214-227. http://doi.org/10.28978/nesciences.1159313
  22. Wei, X. S., Song, Y. Z., Mac Aodha, O., Wu, J., Peng, Y., Tang, J.,. & Belongie, S. (2021). Fine-grained image analysis with deep learning: A survey. IEEE transactions on pattern analysis and machine intelligence, 44(12), 8927-8948. https://doi.org/10.1109/TPAMI.2021.3126648
  23. Xue, M. (2024). Assessing the Recreational Fishers and their Catches based on Social Media Platforms: Privacy and Ethical Data Analysis Considerations. Journal of Wireless Mobile Networks, Ubiquitous Computing, and Dependable Applications, 15(3), 521-542. https://doi.org/10.58346/JOWUA.2024.I3.033
  24. Zhang, X., Huang, B., Chen, G., Radenkovic, M., & Hou, G. (2023). WildFishNet: Open set wild fish recognition deep neural network with fusion activation pattern. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. https://doi.org/10.1109/JSTARS.2023.3299703
  25. Freire, K. M. F., Belhabib, D., Espedido, J. C., Hood, L., Kleisner, K. M., Lam, V. W.,. & Pauly, D. (2020). Estimating global catches of marine recreational fisheries. Frontiers in Marine Science, 7, 12. https://doi.org/10.3389/fmars.2020.00012
  26. Han, K., Wang, Y., Chen, H., Chen, X., Guo, J., Liu, Z.,. & Tao, D. (2022). A survey on vision transformer. IEEE transactions on pattern analysis and machine intelligence, 45(1), 87-110. https://doi.org/10.1109/TPAMI.2022.3152247
  27. Larkin, K. E., Marsan, A. A., Tonné, N., Van Isacker, N., Collart, T., Delaney, C.,. & Calewaert, J. B. (2022). Connecting marine data to society. In Ocean Science Data (pp. 283-317). Elsevier. https://doi.org/10.1016/B978-0-12-823427-3.00003-7
  28. Li, S., Li, P., He, S., Kuai, Z., Gu, Y., Liu, H.,. & Lin, Y. (2024). An Automatic Detection and Statistical Method for Underwater Fish Based on Foreground Region Convolution Network (FR-CNN). Journal of Marine Science and Engineering, 12(8), 1343. https://doi.org/10.3390/jmse12081343
  29. Liu, S., Li, X., Gao, M., Cai, Y., Nian, R., Li, P.,. & Lendasse, A. (2018, October). Embedded online fish detection and tracking system via YOLOv3 and parallel correlation filter. In Oceans 2018 Mts/Ieee Charleston (pp. 1-6). IEEE. https://doi.org/10.1109/OCEANS.2018.8604658
  30. Wei, X. S., Song, Y. Z., Mac Aodha, O., Wu, J., Peng, Y., Tang, J.,. & Belongie, S. (2021). Fine-grained image analysis with deep learning: A survey. IEEE transactions on pattern analysis and machine intelligence, 44(12), 8927-8948. https://doi.org/10.1109/TPAMI.2021.3126648