Implementation of Yolo (You Only Look Once) Algorithm for Drowsiness Detection as an Additional Safety Feature in the Operation of Crane Equipment in Real Time

Riza Adrian Maulana; Hardiansyah

doi:10.31572/inotera.Vol10.Iss1.2025.ID458

Riza Adrian Maulana Universitas Pamulang
Hardiansyah Universitas Pamulang

DOI: https://doi.org/10.31572/inotera.Vol10.Iss1.2025.ID458

Keywords: Detection System, Yolo Algorithm, Drowsiness, Construction Workers

Abstract

Work accidents, especially in the construction sector, are still a serious problem, with fatigue as one of the main causes. Based on data from satudata.kemnaker, the author realizes the need for early prevention solutions to reduce the risk of accidents due to fatigue. One of the approaches proposed is the development of an automatic detection system to recognize workers' facial expressions, especially in detecting levels of freshness and sleepiness. The obstacles that are often faced are limited time and scale in manual monitoring, especially on large-scale construction projects. To overcome this, the You Only Look Once (YOLO) algorithm is used, which is able to detect objects quickly and accurately, to provide continuous monitoring of workers' conditions. This research focuses on the application of the YOLOv8n model in an automatic freshness and sleepiness facial expression detection system. The model is trained using a dataset that includes a variety of facial expressions in different situations, allowing the system to detect worker conditions in real-time and at scale. The evaluation results in this research show very good performance, with precision reaching 99.9%, recall 100%, mAP50 99.5%, and mAP50-90 97.9%. Although the model sometimes makes mistakes in object class recognition, the overall results still show a very high level of accuracy. With this system, it is hoped that it can improve work safety through early detection of signs of fatigue in workers, so that the potential for work accidents can be significantly minimized.

Downloads

Download data is not yet available.

References

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016, pp. 779–788. doi: 10.1109/CVPR.2016.91.

R. Bhardwaj and H. Singh, “Modeling the Effects of Intellectual Capital on Decision Making - A Study of Interaction Moderation with Knowledge Management Process,” Int. J. Comput. Appl., vol. 180, no. 35, pp. 37–50, 2018, doi: 10.5120/ijca2018916885.

M. Hadavi, Z. Ghomian, F. Mohammadi, and A. sahebi, “Workplace violence against health care workers during the COVID-19 Pandemic: A systematic review and meta-analysis,” J. Safety Res., vol. 85, pp. 1–7, 2023, doi: https://doi.org/10.1016/j.jsr.2023.01.001.

M. Sarosa and N. Muna, “Implementasi Algoritma You Only Look Once ( Yolo ) Untuk Implementation of You Only Look Once ( Yolo ) Algorithm for,” J. Teknol. Inf. dan Ilmu Komput., vol. 8, no. 4, pp. 787–792, 2021, doi: 10.25126/jtiik.202184407.

I. M. D. Maleh, R. Teguh, A. S. Sahay, S. Okta, and M. P. Pratama, “Implementasi Algoritma You Only Look Once (YOLO) Untuk Object Detection Sarang Orang Utan Di Taman Nasional Sebangau,” J. Inform., vol. 10, no. 1, pp. 19–27, 2023, doi: 10.31294/inf.v10i1.13922.

K. S. S, I. Taufik, I. Ramadhani, and A. A. Siregar, “Implementation of You Only Look Once Version 8 Algorithm to Detect Multi-Face Drivers and Vehicle Plates,” vol. 11, no. 2, pp. 103–108, 2024.

Q. Aini, N. Lutfiani, H. Kusumah, and M. S. Zahran, “Deteksi dan Pengenalan Objek Dengan Model Machine Learning: Model Yolo,” CESS (Journal Comput. Eng. Syst. Sci., vol. 6, no. 2, p. 192, 2021, doi: 10.24114/cess.v6i2.25840.

A. Wibowo, L. Lusiana, and T. K. Dewi, “Implementasi Algoritma Deep Learning You Only Look Once (YOLOv5) Untuk Deteksi Buah Segar Dan Busuk,” Paspalum J. Ilm. Pertan., vol. 11, no. 1, p. 123, 2023, doi: 10.35138/paspalum.v11i1.489.

L. Rahma, H. Syaputra, A. H. Mirza, and S. D. Purnamasari, “Objek Deteksi Makanan Khas Palembang Menggunakan Algoritma YOLO (You Only Look Once),” J. Nas. Ilmu Komput., vol. 2, no. 3, pp. 213–232, 2021, doi: 10.47747/jurnalnik.v2i3.534.