Automatic fight detection in surveillance videos

Yujun Eugene FU, Hong Va LEONG, Grace NGAI, Stephen C.F. CHAN

Research output: Contribution to journalArticlespeer-review

26 Citations (Scopus)

Abstract

Purpose: Social signal processing under affective computing aims at recognizing and extracting useful human social interaction patterns. Fight is a common social interaction in real life. A fight detection system finds wide applications. This paper aims to detect fights in a natural and low-cost manner. 

Design/methodology/approach: Research works on fight detection are often based on visual features, demanding substantive computation and good video quality. In this paper, the authors propose an approach to detect fight events through motion analysis. Most existing works evaluated their algorithms on public data sets manifesting simulated fights, where the fights are acted out by actors. To evaluate real fights, the authors collected videos involving real fights to form a data set. Based on the two types of data sets, the authors evaluated the performance of their motion signal analysis algorithm, which was then compared with the state-of-the-art approach based on MoSIFT descriptors with Bag-of-Words mechanism, and basic motion signal analysis with Bag-of-Words. 

Findings: The experimental results indicate that the proposed approach accurately detects fights in real scenarios and performs better than the MoSIFT approach. 

Originality/value: By collecting and annotating real surveillance videos containing real fight events and augmenting with well-known data sets, the authors proposed, implemented and evaluated a low computation approach, comparing it with the state-of-the-art approach. The authors uncovered some fundamental differences between real and simulated fights and initiated a new study in discriminating real against simulated fight events, with very good performance. Copyright © 2017 Emerald Publishing Limited.

Original languageEnglish
Pages (from-to)130-156
JournalInternational Journal of Pervasive Computing and Communications
Volume13
Issue number2
Early online dateJun 2017
DOIs
Publication statusPublished - 2017

Citation

Fu, E. Y., Leong, H. V., Ngai, G., & Chan, S. C. F. (2017). Automatic fight detection in surveillance videos. International Journal of Pervasive Computing and Communications, 13(2), 130-156. https://doi.org/10.1108/IJPCC-02-2017-0018

Keywords

  • Optical flow
  • Bag-of-words
  • MoSIFT
  • Motion analysis
  • Real and simulated fights

Fingerprint

Dive into the research topics of 'Automatic fight detection in surveillance videos'. Together they form a unique fingerprint.