Enhancing video anomaly detection for human suspicious behavior through deep hybrid temporal spatial network

Abstract

Abnormal behavior exhibited by individuals with particular intentions is common, and when such behavior occurs in public places, it can cause physical and mental harm to others. Considering the rise in the automated approach for anomaly detection in videos, accuracy becomes essential. Most existing models follow a deep learning architecture, which faces challenges due to variations in motion. This research work develops a deep learning based hybrid architecture with temporal and spatial features. The hybrid temporal spatial network (HTSNet) consists of two customized architectures: a graph neural network (GNN) and a convolutional neural network (CNN). HTSNet combined with a novel classifier to extract features and classify normal and abnormal behavior. The performance of HTSNet is rigorously evaluated using the University of California, San Diego-Pedestrian 1 (UCSD Ped1) dataset, a benchmark in computer vision research for anomaly detection in video surveillance. The effectiveness of HTSNet is demonstrated through a comparative analysis with current state-of-the-art methods, using the area under the curve (AUC) metric as a standard measure of performance. This paper contributes to the advancement of video surveillance technology, providing a robust framework for enhancing public safety and security in an increasingly digital world.