Real-Time Human Detection and Face Recognition System Using CCTV Stream and Localhost-Based Monitoring Dashboard
DOI:
https://doi.org/10.51903/elkom.v19i1.3954Keywords:
Computer Vision, Human Detection, Face Recognition, Closed-Circuit Television , Localhost DashboardAbstract
This study presents a real-time human detection and face recognition system that utilizes CCTV video streams and a localhost-based monitoring dashboard. Using a Research and Development (R&D) approach, a computer vision application was designed and implemented on a laptop platform. Human detection was performed using YOLO11n, facial regions were localized with YuNet, and face recognition was carried out using SFace to distinguish registered individuals from unknown persons. The detection results were displayed through a web-based dashboard that provided live video streaming, AI status information, face registration, and detection history records. Performance evaluation was conducted under various conditions, including human and non-human scenarios, registered and unknown faces, dark-room environments, and night-vision mode. The dashboard maintained a preview rate of approximately 20–30 FPS. Experimental results showed that human detection achieved an accuracy of 80%, while face recognition achieved 72% accuracy under the tested conditions. Alert Level 1 was triggered when a person was detected, whereas Alert Level 2 was activated for unknown-face events. The findings demonstrate the potential of integrating lightweight computer vision models into a local surveillance system without relying on cloud infrastructure. Nevertheless, system performance remained dependent on factors such as lighting conditions, camera distance, face orientation, image quality, and available computing resources.
References
[1] A. I. Awad, A. Babu, E. Barka, and K. Shuaib, “AI-powered biometrics for Internet of Things security: A review and future vision,” Journal of Information Security and Applications, vol. 82, p. 103748, 2024, doi: 10.1016/j.jisa.2024.103748.
[2] E. Badidi, K. Moumane, and F. E. Ghazi, “Opportunities, applications, and challenges of edge-AI enabled video analytics in smart cities: A systematic review,” IEEE Access, vol. 11, pp. 80543–80572, 2023, doi: 10.1109/ACCESS.2023.3300658.
[3] J. Deng, J. Guo, J. Yang, N. Xue, I. Kotsia, and S. Zafeiriou, “ArcFace: Additive angular margin loss for deep face recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 10, pp. 5962–5979, 2022, doi: 10.1109/TPAMI.2021.3087709.
[4] K. U. Duja, I. A. Khan, and M. Alsuhaibani, “Video surveillance anomaly detection: A review on deep learning benchmarks,” IEEE Access, vol. 12, pp. 164811–164842, 2024, doi: 10.1109/ACCESS.2024.3491868.
[5] H. T. Duong, V. T. Le, and V. T. Hoang, “Deep learning-based anomaly detection in video surveillance: A survey,” Sensors, vol. 23, no. 11, p. 5024, 2023, doi: 10.3390/s23115024.
[6] A. El-Alami, Y. Nadir, and K. Mansouri, “A review of object detection approaches for traffic surveillance systems,” International Journal of Electrical and Computer Engineering, vol. 14, no. 5, pp. 5221–5233, 2024, doi: 10.11591/ijece.v14i5.pp5221-5233.
[7] H. L. Gururaj, B. C. Soundarya, S. Priya, J. Shreyas, and F. Flammini, “A comprehensive review of face recognition techniques, trends and challenges,” IEEE Access, vol. 12, pp. 107903–107926, 2024, doi: 10.1109/ACCESS.2024.3424933.
[8] M. Hussain, “YOLOv1 to v8: Unveiling each variant—A comprehensive review of YOLO,” IEEE Access, vol. 12, pp. 42816–42833, 2024, doi: 10.1109/ACCESS.2024.3378568.
[9] F. S. Indra, A. Aryanti, and R. A. Halimatussa’diyah, “Sistem pengenalan wajah real-time menggunakan YOLOv7 untuk akses gedung TVRI Palembang berbasis web,” Journal of Technology and Informatics (JoTI), vol. 7, no. 2, pp. 147–160, 2025, doi: 10.37802/joti.v7i2.1063.
[10] L. Jiao, F. Zhang, F. Liu, S. Yang, L. Li, Z. Feng, and R. Qu, “A survey of deep learning-based object detection,” IEEE Access, vol. 7, pp. 128837–128868, 2019, doi: 10.1109/ACCESS.2019.2939201.
[11] P. Mittal, “A comprehensive survey of deep learning-based lightweight object detection models for edge devices,” Artificial Intelligence Review, vol. 57, p. 242, 2024, doi: 10.1007/s10462-024-10877-1.
[12] Z. Ouardirhi, S. A. Mahmoudi, and M. Zbakh, “Enhancing object detection in smart video surveillance: A survey of occlusion-handling approaches,” Electronics, vol. 13, no. 3, p. 541, 2024, doi: 10.3390/electronics13030541.
[13] A. Rahim, Y. Zhong, T. Ahmad, S. Ahmad, P. Plawiak, and M. Hammad, “Enhancing smart home security: Anomaly detection and face recognition in smart home IoT devices using logit-boosted CNN models,” Sensors, vol. 23, no. 15, p. 6979, 2023, doi: 10.3390/s23156979.
[14] A. L. S. Safre, A. Torres-Rua, B. L. Black, and S. Young, “Deep learning framework for fruit counting and yield mapping in tart cherry using YOLOv8 and YOLO11,” Smart Agricultural Technology, vol. 11, p. 100948, 2025, doi: 10.1016/j.atech.2025.100948.
[15] R. Sapkota, M. Flores-Calero, R. Qureshi, C. Badgujar, U. Nepal, A. Poulose, P. Zeno, U. B. P. Vaddevolu, S. Khan, M. Shoman, H. Yan, and M. Karkee, “YOLO advances to its genesis: A decadal and comprehensive review of the You Only Look Once (YOLO) series,” Artificial Intelligence Review, vol. 58, p. 274, 2025, doi: 10.1007/s10462-025-11253-3.
[16] I. H. Sarker, “Deep learning: A comprehensive overview on techniques, taxonomy, applications and research directions,” SN Computer Science, vol. 2, p. 420, 2021, doi: 10.1007/s42979-021-00815-1.
[17] A. A. Septria, A. S. Handayani, and N. Nasron, “Real-time retail shelf-stock detection with YOLOv7,” Jurnal Teknik Informatika, vol. 18, no. 2, pp. 327–338, 2025, doi: 10.15408/jti.v18i2.46448.
[18] J. Terven, D. M. Cordova-Esparza, and J. A. Romero-Gonzalez, “A comprehensive review of YOLO architectures in computer vision: From YOLOv1 to YOLOv8 and YOLO-NAS,” Machine Learning and Knowledge Extraction, vol. 5, no. 4, pp. 1680–1716, 2023, doi: 10.3390/make5040083.
[19] M. Wang and W. Deng, “Deep face recognition: A survey,” Neurocomputing, vol. 429, pp. 215–244, 2021, doi: 10.1016/j.neucom.2020.10.081.
[20] Q. Wang, G. Feng, and Z. Li, “A lightweight person detector for surveillance footage based on YOLOv8n,” Sensors, vol. 25, no. 2, p. 436, 2025, doi: 10.3390/s25020436.
[21] X. Wang, Y. C. Wu, M. Zhou, and H. Fu, “Beyond surveillance: Privacy, ethics, and regulations in face recognition technology,” Frontiers in Big Data, vol. 7, p. 1337465, 2024, doi: 10.3389/fdata.2024.1337465.
[22] W. Wu, H. Peng, and S. Yu, “YuNet: A tiny millisecond-level face detector,” Machine Intelligence Research, vol. 20, pp. 656–665, 2023, doi: 10.1007/s11633-023-1423-y.
[23] Y. Zennayi, S. Benaissa, H. Derrouz, and Z. Guennoun, “Unauthorized access detection system to the equipments in a room based on the persons identification by face recognition,” Engineering Applications of Artificial Intelligence, vol. 124, p. 106637, 2023, doi: 10.1016/j.engappai.2023.106637.
[24] H. Zhang, G. Zhou, W. He, and H. Deng, “Classroom behavior detection method based on PLA-YOLO11n,” Sensors, vol. 25, no. 17, p. 5386, 2025, doi: 10.3390/s25175386.
[25] Z. Q. Zhao, P. Zheng, S. T. Xu, and X. Wu, “Object detection with deep learning: A review,” IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 11, pp. 3212–3232, 2019, doi: 10.1109/TNNLS.2018.2876865.
[26] Y. Zhong, W. Deng, J. Hu, D. Zhao, X. Li, and D. Wen, “SFace: Sigmoid-constrained hypersphere loss for robust face recognition,” IEEE Transactions on Image Processing, vol. 30, pp. 2587–2598, 2021, doi: 10.1109/TIP.2020.3048632.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Elkom: Jurnal Elektronika dan Komputer
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
