Hierarchical spatial object detection for ATM vandalism surveillance

Jun Yeop Lee, Chul Jin Cho, David K. Han, Hanseok Ko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, a multi-modal classification is proposed for recognizing vandalism against Automatic Teller Machines (ATMs). The visual and textual information base model is developed here to identify external threats on ATMs. The model discriminates threatening behaviors from those that are benign in the image. It provides a level of confidence in the threat recognition by visual object classification coupled with word vector distance measure. To achieve our goal, real-time object detection based on a Region Convolutional Neural Network (R-CNN) first detects objects in the scene and word embedding technique allows to measure distance between the detected object label with predefined tools assumed to be used for vandalizing ATMs. Similarity measure from word embedding not only determines whether the scene may lead to any nefarious activities, but also would provide the level of confidence in occurrence of such incidents. From the experimental evaluation, it is shown that the method is effective and delivers a quantitative measure on decisions it makes.

Original languageEnglish
Title of host publicationProceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538692943
DOIs
Publication statusPublished - 2019 Feb 11
Event15th IEEE International Conference on Advanced Video and Signal-Based Surveillance, AVSS 2018 - Auckland, New Zealand
Duration: 2018 Nov 272018 Nov 30

Publication series

NameProceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance

Conference

Conference15th IEEE International Conference on Advanced Video and Signal-Based Surveillance, AVSS 2018
CountryNew Zealand
CityAuckland
Period18/11/2718/11/30

Fingerprint

Automatic teller machines
Labels
Neural networks
Object detection

ASJC Scopus subject areas

  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Media Technology

Cite this

Lee, J. Y., Cho, C. J., Han, D. K., & Ko, H. (2019). Hierarchical spatial object detection for ATM vandalism surveillance. In Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance [8639154] (Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/AVSS.2018.8639154

Hierarchical spatial object detection for ATM vandalism surveillance. / Lee, Jun Yeop; Cho, Chul Jin; Han, David K.; Ko, Hanseok.

Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance. Institute of Electrical and Electronics Engineers Inc., 2019. 8639154 (Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lee, JY, Cho, CJ, Han, DK & Ko, H 2019, Hierarchical spatial object detection for ATM vandalism surveillance. in Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance., 8639154, Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance, Institute of Electrical and Electronics Engineers Inc., 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance, AVSS 2018, Auckland, New Zealand, 18/11/27. https://doi.org/10.1109/AVSS.2018.8639154
Lee JY, Cho CJ, Han DK, Ko H. Hierarchical spatial object detection for ATM vandalism surveillance. In Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance. Institute of Electrical and Electronics Engineers Inc. 2019. 8639154. (Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance). https://doi.org/10.1109/AVSS.2018.8639154
Lee, Jun Yeop ; Cho, Chul Jin ; Han, David K. ; Ko, Hanseok. / Hierarchical spatial object detection for ATM vandalism surveillance. Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance. Institute of Electrical and Electronics Engineers Inc., 2019. (Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance).
@inproceedings{0011238c09a542ea9cdfaa68e5d48d40,
title = "Hierarchical spatial object detection for ATM vandalism surveillance",
abstract = "In this paper, a multi-modal classification is proposed for recognizing vandalism against Automatic Teller Machines (ATMs). The visual and textual information base model is developed here to identify external threats on ATMs. The model discriminates threatening behaviors from those that are benign in the image. It provides a level of confidence in the threat recognition by visual object classification coupled with word vector distance measure. To achieve our goal, real-time object detection based on a Region Convolutional Neural Network (R-CNN) first detects objects in the scene and word embedding technique allows to measure distance between the detected object label with predefined tools assumed to be used for vandalizing ATMs. Similarity measure from word embedding not only determines whether the scene may lead to any nefarious activities, but also would provide the level of confidence in occurrence of such incidents. From the experimental evaluation, it is shown that the method is effective and delivers a quantitative measure on decisions it makes.",
author = "Lee, {Jun Yeop} and Cho, {Chul Jin} and Han, {David K.} and Hanseok Ko",
year = "2019",
month = "2",
day = "11",
doi = "10.1109/AVSS.2018.8639154",
language = "English",
series = "Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance",

}

TY - GEN

T1 - Hierarchical spatial object detection for ATM vandalism surveillance

AU - Lee, Jun Yeop

AU - Cho, Chul Jin

AU - Han, David K.

AU - Ko, Hanseok

PY - 2019/2/11

Y1 - 2019/2/11

N2 - In this paper, a multi-modal classification is proposed for recognizing vandalism against Automatic Teller Machines (ATMs). The visual and textual information base model is developed here to identify external threats on ATMs. The model discriminates threatening behaviors from those that are benign in the image. It provides a level of confidence in the threat recognition by visual object classification coupled with word vector distance measure. To achieve our goal, real-time object detection based on a Region Convolutional Neural Network (R-CNN) first detects objects in the scene and word embedding technique allows to measure distance between the detected object label with predefined tools assumed to be used for vandalizing ATMs. Similarity measure from word embedding not only determines whether the scene may lead to any nefarious activities, but also would provide the level of confidence in occurrence of such incidents. From the experimental evaluation, it is shown that the method is effective and delivers a quantitative measure on decisions it makes.

AB - In this paper, a multi-modal classification is proposed for recognizing vandalism against Automatic Teller Machines (ATMs). The visual and textual information base model is developed here to identify external threats on ATMs. The model discriminates threatening behaviors from those that are benign in the image. It provides a level of confidence in the threat recognition by visual object classification coupled with word vector distance measure. To achieve our goal, real-time object detection based on a Region Convolutional Neural Network (R-CNN) first detects objects in the scene and word embedding technique allows to measure distance between the detected object label with predefined tools assumed to be used for vandalizing ATMs. Similarity measure from word embedding not only determines whether the scene may lead to any nefarious activities, but also would provide the level of confidence in occurrence of such incidents. From the experimental evaluation, it is shown that the method is effective and delivers a quantitative measure on decisions it makes.

UR - http://www.scopus.com/inward/record.url?scp=85063269552&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063269552&partnerID=8YFLogxK

U2 - 10.1109/AVSS.2018.8639154

DO - 10.1109/AVSS.2018.8639154

M3 - Conference contribution

AN - SCOPUS:85063269552

T3 - Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance

BT - Proceedings of AVSS 2018 - 2018 15th IEEE International Conference on Advanced Video and Signal-Based Surveillance

PB - Institute of Electrical and Electronics Engineers Inc.

ER -