Automatic Surveillance of People and Objects on Railway Tracks.
DOI:
https://doi.org/10.9781/ijimai.2024.08.004Keywords:
Computer vision, Machine Learning, Neural Networks, Railway Safety, SurveillanceAbstract
This paper describes the development and evaluation of a surveillance system for the detection of people and objects on railroad tracks in real time. Firstly, the paper evaluates several background subtraction techniques including CNNs and the object detection library called YOLO. Then we describe a novel strategy to mitigate the occlusion caused by the perspective of the camera and the integration of an alarms and pre-alarms policy. To evaluate its performance, we have implemented and automated the control and notification aspects of the surveillance system using computer vision techniques. This setup, running on a standard PC, achieves an average frame rate of 15 FPS and a latency of 0.54 seconds per frame, meeting real-time expectations in terms of both false alarms and precision in operational mode. The results from experiments conducted with a publicly available recorded video dataset from Metro de Madrid facilities demonstrate significant improvements over current state-of the-art solutions. These improvements include better accident anticipation and enhanced information provided to the operator using a standard low-cost camera. Consequently, we conclude that the approach described in this paper is both effective and a more practical, cost-efficient alternative to the other solutions reviewed.Downloads
References
S. Glimne, R. Brautaset and C. Österman, “Visual Fatigue During Control Room Work in Process Industries,” vol. 65, no. 4, pp. 903-914, doi: 10.3233/WOR-203141. PMID: 32310219; PMCID: PMC7242839. 2020.
Y. Lei, T. Tian, B. Jiang, F. Qi, F. Jia, Q. Qu, “Research and Application of the Obstacle Avoidance System for High-Speed Railway Tunnel Lining Inspection Train Based on Integrated 3D LiDAR and 2D Camera Machine Vision Technology,” Applied Sciences, vol. 13, no. 13, p. 7689, 2023.
M. Li, B. Peng, J. Liu and D. Zhai, “RBNet: An Ultrafast Rendering-Based Architecture for Railway Defect Segmentation,” IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1-8, 2023.
R. Goel, A. Sharma and R. Kapoor, “An Efficient Object and Railway Track Recognition in Thermal Images Using Deep Learning,” Emergent Converging Technologies and Biomedical Systems: Select Proceedings of ETBS 2021 (pp. 241-253). Springer Singapore. 2002.
S. Oh, S. Park and C. Lee, “A platform surveillance monitoring system using image processing for passenger safety in railway station,” ICCAS 2007 - International Conference on Control, Automation and Systems, pp. 394-398, January 2007.
M. Arastounia, “Automated recognition of railroad infrastructure in rural areas from LIDAR data,” Remote Sensing, vol. 7, no. 11, 2015.
B. Le Saux, A. Beaupère, A. Boulch, J. Brossard, A. Manier, and G. Villemin, “Railway detection: From Filtering to segmentation networks” Proc. IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain, Jul. 2018.
T. Xiao, Y. Xu, and H. Yu, “Research on Obstacle Detection Method of Urban Rail Transit Based on Multisensor Technology,” Journal of Artificial Intelligence and Technology, vol. 1, no. 1, pp. 61-67, 2021.
S. Taori, V. Kakade, S. Gandhi, and D. Jadhav, “Multi Sensor Obstacle Detection on Railway Tracks,” International Research Journal of Engineering and Technology, vol. 8, no. 3, pp. 826-829, 2021.
F. Kaleli and Y. S. Akgul, “Vision-based railroad track extraction using dynamic programming,” Proceedings of 12th International IEEE Conference on Intelligent Transportation Systems, St. Louis, MO, USA, oct. 2009, pp.1-6.
Y. Wang, L. Wang, Y. H. Hu, and J. Qiu, “RailNet: A Segmentation Network for Railroad Detection,” IEEE Access, vol. 7, pp. 143772–143779, 2019.
M. Ghorbanalivakili, J. Kang, G. Sohn, D. Beach and V. Marin, “TPE-Net: Track Point Extraction and Association Network for Rail Path Proposal Generation,” 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE), Auckland, New Zealand, 2023, pp. 1-7, doi: 10.1109/CASE56687.2023.10260541.
M. Qasim Gandapur, and E. Verdú, “ConvGRU-CNN: Spatiotemporal Deep Learning for Real-World Anomaly Detection in Video Surveillance System,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 8, no. 4, pp. 88-95, 2023.
M. Adimoolam, S. Mohan, and G. Srivastava, “A novel technique to detect and track multiple objects in dynamic video surveillance systems,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 7, no. 4, pp. 112-120, 2022.
A. D. Petrović, M. Banić, M. Simonović, D. Stamenković, A. Miltenović, G. Adamović, and D. Rangelov, “Integration of Computer Vision and Convolutional Neural Networks in the System for Detection of Rail Track and Signals on the Railway”, Applied Sciences, vol. 12, no. 12, p. 6045, 2022.
J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” Jun. 2015, doi: 10.48550/arXiv.1506.02640.
K. He, G. Gkioxari, P. Dollár, and R. Girshick, “Mask R-CNN,” in Proc. 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 2017, pp. 2980-2988.
T.-Y. Lin et al., “Microsoft COCO: Common Objects in Context”, in: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8693, Springer, Cham, 2014, pp. 740-755.
H. Pan, Y. Li, H. Wang, and X. Tian, “Railway Obstacle Intrusion Detection Based on Convolution Neural Network Multitask Learning,” Electronics, vol. 11, no. 17, p. 2697, 2022.
K. Matt Nolan, “L’intelligence artificielle au service de la sécurité sur les voies de la ligne Docklands Light Railway du métro londonien,” Mobilité Urbaine, France, Intelligence Artificielle, Sécurité. Mar. 2022.
Z. Chen, J. Yang, C. Yang, “BrightsightNet: A lightweight progressive low-light image enhancement network and its application in “Rainbow” maglev train,” Journal of King Saud University - Computer and Information Sciences, vol. 35, no. 10, p. 101814, 2023.
C. Meng, Z. Wang, L. Shi, Y. Gao, Y. Tao, and L. Wei, “SDRC-YOLO: A Novel Foreign Object Intrusion Detection Algorithm in Railway Scenarios,” Electronics, vol. 12, no. 5, p. 1256, 2023.
Z. Chen, J. Yang, L. Chen, Z. Feng, L. Jia, “Efficient railway track region segmentation algorithm based on lightweight neural network and cross-fusion decoder,” Automation in Construction, vol. 155, p. 105069, 2023.
Z. Feng, J. Yang, Z. Chen, and Z. Kang, “LRseg: An efficient railway region extraction method based on lightweight encoder and self-correcting decoder”, Expert Systems with Applications, vol. 238, part F., p. 122386, 2024.
Z. Chen, J. Yang, Z. Feng, and H. Zhu, “RailFOD23: A dataset for foreign object detection on railroad transmission lines,” Scientific Data, vol. 11, article no. 72, 2024.
Z. Zivkovic, “Improved adaptive Gaussian mixture model for background subtraction,” in Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 2, Cambridge, UK, 2004, pp. 28-31, doi: 10.1109/ICPR.2004.1333992.
F. Porikli and O. Tuzel, “Bayesian background modeling for foreground detection,” in Proceeding of theACM International Workshop on Video Surveillance and Sensor Networks (VSSN 2005), November 2005, pp. 55-58.
T. Cover and P. Hart, “Nearest neighbor pattern classification”, IEEE Transactions on Information Theory, vol. 13, no. 1, pp. 21-27, 1967, doi: 10.1109/TIT.1967.1053964.
R. Kalsotra and S. Arora, “Background subtraction for moving object detection: explorations of recent developments and challenges,” TheVisual Computer, vol. 38, pp. 4151–4178, 2022. https://doi.org/10.1007/s00371-021-02286-0
B. Farnham, S. Tokyo, B. Boston, F. Sebastopol, and T. Beijing, “Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow. Concepts, Tools, and Techniques to Build Intelligent Systems,” O’Reilly Second Edition, 2017.
Downloads
Published
-
Abstract426
-
PDF65
Submit Article
Information
