Journals / Konya Journal of Engineering Sciences / 2023 / Cilt: 11 Sayı: 2

DEEP LEARNING BASED HUMAN ROBOT INTERACTION WITH 5G COMMUNICATION

Pages
423–438
Publication Date
2023-06-01
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

While the highest detection accuracy obtained with the YOLOv4 algorithm during the test phase was 99.75% in the front camera, it was 99.83% in the YOLOv5 algorithm; YOLOv4 detection accuracy was the highest in the side camera of 97.59%, and YOLOv5 detection accuracy was 97.9%.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Factories focusing on digital transformation accelerate their production and surpass their competitors by increasing their controllability and efficiency.
📊
Key Findings & Data:In this study, the data obtained by image processing with the aim of digital transformation was transferred to the collaborative robot arm with 5G communication and the robot arm was remotely controlled.
💡
Conclusion & Impact:While the highest detection accuracy obtained with the YOLOv4 algorithm during the test phase was 99.75% in the front camera, it was 99.83% in the YOLOv5 algorithm; YOLOv4 detection accuracy was the highest in the side camera of 97.59%, and YOLOv5 detection accuracy was 97.9%.
🔬Design:Research Article
📍Scope:Comprehensive Sample
⚙️Variables:Collaborative Robot Arm · Digital Transformation · Object Detection

Abstract

Factories focusing on digital transformation accelerate their production and surpass their competitors by increasing their controllability and efficiency. In this study, the data obtained by image processing with the aim of digital transformation was transferred to the collaborative robot arm with 5G communication and the robot arm was remotely controlled. A 3D-printed humanoid hand is mounted on the end of the robot arm for bin picking. Each finger is controlled by five servo motors. For finger control, the user wore a glove, and the finger positions of the user were transferred to the servo motors thanks to each flex sensor attached to the glove. In this way, the desired pick and place process is provided. The position control of the robot arm was realized with image processing. The gloves worn by the user were determined by two different YOLO (You only look once) methods. YOLOv4 and YOLOv5 algorithms were compared by using Python software language in object detection. While the highest detection accuracy obtained with the YOLOv4 algorithm during the test phase was 99.75% in the front camera, it was 99.83% in the YOLOv5 algorithm; YOLOv4 detection accuracy was the highest in the side camera of 97.59%, and YOLOv5 detection accuracy was 97.9%.

🔖

Cite This Article

BARSTUĞAN, M., OSMANPAŞAOĞLU, Z. (2023). DEEP LEARNING BASED HUMAN ROBOT INTERACTION WITH 5G COMMUNICATION. Konya Journal of Engineering Sciences, Cilt: 11 Sayı: 2, 423–438. https://ajindex.com/articles/937918

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (12)

  1. X. Chen, X. Huang, Y. Wang, and X. Gao, "Combination of augmented reality based brain- computer interface and computer vision for high-level control of a robotic arm," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 28, no. 12, pp. 3140-3147, 2020
  2. Z. Zhang, Y. Huang, S. Chen, J. Qu, X. Pan, T. Yu, and Y. Li, "An intention-driven semi- autonomous intelligent robotic system for drinking," Frontiers in Neurorobotics, vol. 11, p. 1-14, 2017
  3. S. M. Achari, S. G. Mirji, C. P. Desai, M. S. Hulasogi, and S. P. Awari, "Gesture based wireless control of robotic hand using image processing," International Research Journal of Engineering and Technology, vol. 5, no. 5, pp. 3340-3345, 2018
  4. J. O. P. Arenas, R. J. Moreno, and R. D. H. Beleño, "Convolutional neural network with a dag architecture for control of a robotic arm by means of hand gestures," Contemporary Engineering Sciences, vol. 11, no. 12, pp. 547-557, 2018
  5. P. Atre, S. Bhagat, N. Pooniwala, and P. Shah, "Efficient and feasible gesture controlled robotic arm," in 2018 Second International Conference on Intelligent Computing and Control Systems, 2018, pp. 1-6: IEEE
  6. A. A. Malik and A. J. R. Brem, "Digital twins for collaborative robots: A case study in human- robot interaction," Robotics and Computer-Integrated Manufacturing, vol. 68, pp. 1-16, 2021
  7. J. P. Vasconez, G. A. Kantor, and F. A. A. Cheein, "Human–robot interaction in agriculture: A survey and current challenges," Biosystems engineering, vol. 179, pp. 35-48, 2019
  8. K. Fujii, G. Gras, A. Salerno, and G.-Z. Yang, "Gaze gesture based human robot interaction for laparoscopic surgery," Medical image analysis, vol. 44, pp. 196-214, 2018
  9. M. N. Datta, Y. Rathi, and M. Eliazer, "Wheat heads detection using deep learning algorithms," Annals of the Romanian Society for Cell Biology, vol. 25, no.5, pp. 5641-5654, 2021
  10. F. Jubayer, J. A. Soeb, A. N. Mojumder, M. K. Paul, P. Barua, S. Kayshar, S. S. Akter, M. Rahman, and A. Islam, "Detection of mold on the food surface using YOLOv5," Detection of mold on the food surface using YOLOv5, vol. 4, pp. 724-728, 2021
  11. M. Karakaya, M. F. Celebi, A. E. Gök, and S. Ersoy, "Discovery Of Agricultural Diseases By Deep Learning And Object Detection," Environmental Engineering and Management Journal, vol. 21, no. 1, pp. 163-173, 2022
  12. R. Li and Y. J. E. Wu, "Improved YOLO v5 Wheat Ear Detection Algorithm Based on Attention Mechanism," Electronics, vol.