Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Nov 30;14(1):29818.
doi: 10.1038/s41598-024-81387-x.

Abnormal events detection using spatio-temporal saliency descriptor and fuzzy representation analysis

R Tino Merlin  1 , R Karthick  2 , A Aalan Babu  3 , G Vennira Selvi  4 , D Usha  5 , R Nithya  6
Affiliations

Abnormal events detection using spatio-temporal saliency descriptor and fuzzy representation analysis

R Tino Merlin et al. Sci Rep. .

Abstract

In recent years, the research on abnormal events detection is a significant work in surveillance video. Many researchers have been attracted by this work for the past two decades. As a result, several abnormal event detection approaches have been developed. Though several approaches have been used in the field still many problems remain to get the abnormal events detection accuracy. Moreover, many feature representations have limited capability to describe the content since several research works applied hand craft features, this type of feature can work in limited problems. To overcome this problem, this paper introduced the novel feature descriptor namely STS-D (Spatial and Temporal Saliency - Descriptor), which includes spatial and temporal information of the objects. This feature descriptor efficiently describes the shape and speed of the object. To find the anomaly score, fuzzy representation is modeled to efficiently differentiate the normal and abnormal events using fuzzy membership degree. The benchmark datasets UMN, UCSD Ped1 and Ped2 and real time roadway surveillance dataset are used to evaluate the performance of the proposed approach. Also, several existing abnormal events detection approaches are used to compare with the proposed method to evaluate the effectiveness of the proposed work.

Keywords: And abnormal events detection; Fuzzy representation; Influence score; Spatio-temporal descriptor.

PubMed Disclaimer

Conflict of interest statement

Declarations. Competing interests: The authors declare no competing interests.

Figures

Fig. 1
Fig. 1
Examples of normal and abnormal events.
Fig. 2
Fig. 2
The proposed work flow diagram.
Fig. 3
Fig. 3
An illustration of the STS-C via ordered pair of Cartesian product. (Δ denotes gradient values and ↔ denotes optical flow magnitude values where each coordinate gradient and magnitude are differentiated by different colours).
Fig. 4
Fig. 4
The visual results of proposed method.
Fig. 5
Fig. 5
The resultant real-time abnormal events frames.
See this image and copyright information in PMC

References

    1. Xiong, G. et al. An energy model approach to people counting for abnormal crowd behaviour detection, Elsevier, Neurocomputing. 83, 121–135 (2011).
    1. Xu, D. et al. Video Anomaly Detection Based on a Hierarchical Activity Discovery within spatio -temporal Contexts. (Elsevier, Neurocomputing, 143, 144–152 2014).
    1. Angela, A., Sodemann, M. P., Ross & Borghetti, B. J. A review of anomaly detection in automated surveillance. IEEE Trans. on Systems. Man, and Cybernetics. 42, 1257–1271 (2012).
    1. Yuan, Y., Wang, D. & Wang, Q. Anomaly detection in traffic scenes via spatial-aware motion reconstruction. IEEE Trans. on Intelligent Transportation Systems.18, 1–12 (2016).
    1. Kaelon Lloyd, P. L., Rosin, D., Marshall, Simon, C. & Moore March, Detecting violent and abnormal crowd activity using temporal analysis of grey level co-occurrence matrix (GLCM)-based texture measures. Springer, Machine Vision and Applications. 28,1–11 (2017).

LinkOut - more resources