Awesome Video Anomaly Detection

Datasets

1. UMN Download link
2. UCSD Download link
3. Subway Entrance/Exit Download link
4. CUHK Avenue Download link
   • HD-Avenue
5. ShanghaiTech Download link
   • HD-ShanghaiTech
6. UCF-Crime (Weakly Supervised)
   • UCFCrime2Local (subset of UCF-Crime but with spatial annotations.) Download_link
   • Spatial Temporal Annotations Download_link
7. Traffic-Train
8. Belleview
9. Street Scene (WACV 2020) Download link
10. IITB-Corridor (WACV 2020)

The Datasets belowed are about Traffic Accidents Anticipating in Dashcam videos or Surveillance videos

1. CADP (CarCrash Accidents Detection and Prediction)
2. DAD paper, Download link
3. A3D paper, Download link
4. DADA Download link
5. DoTA Download_link
6. Iowa DOT Download_link

Method

Unsupervised

2016

1. [Conv-AE] Learning Temporal Regularity in Video Sequences, CVPR 16. Code

2017

1. [Hinami.etl] Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge, ICCV 2017. (Explainable VAD)
2. [Stacked-RNN] A revisit of sparse coding based anomaly detection in stacked rnn framework, ICCV 2017. Code
3. [ConvLSTM-AE] Remembering history with convolutional LSTM for anomaly detection, ICME 2017.Code
4. [Conv3D-AE] Spatio-Temporal AutoEncoder for Video Anomaly Detection,ACM MM 17.
5. [Unmasking] Unmasking the abnormal events in video, ICCV 17.
6. [DeepAppearance] Deep appearance features for abnormal behavior detection in video

2018

1. [FramePred] Future Frame Prediction for Anomaly Detection – A New Baseline, CVPR 2018. Code
2. [ALOOC] Adversarially Learned One-Class Classifier for Novelty Detection, CVPR 2018. Code
3. Detecting Abnormality Without Knowing Normality: A Two-stage Approach for Unsupervised Video Abnormal Event Detection, ACM MM 18.

2019

1. [Mem-AE] Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detection, ICCV 2019.Code
2. [Skeleton-based] Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos, CVPR 2019.Code
3. [Object-Centric] Object-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection, CVPR 2019.
4. [Appearance-Motion Correspondence] Anomaly Detection in Video Sequence with Appearance-Motion Correspondence, ICCV 2019.Code
5. [AnoPCN]AnoPCN: Video Anomaly Detection via Deep Predictive Coding Network, ACM MM 2019.

2020

1. [Street-Scene] Street Scene: A new dataset and evaluation protocol for video anomaly detection, WACV 2020.
2. [Rodrigurs.etl]) Multi-timescale Trajectory Prediction for Abnormal Human Activity Detection, WACV 2020.
3. [GEPC] Graph Embedded Pose Clustering for Anomaly Detection, CVPR 2020.Code
4. [Self-trained] Self-trained Deep Ordinal Regression for End-to-End Video Anomaly Detection, CVPR 2020.
5. [MNAD] Learning Memory-guided Normality for Anomaly Detection, CVPR 2020. Code
6. [Continual-AD]] Continual Learning for Anomaly Detection in Surveillance Videos,CVPR 2020 Worksop.
7. [OGNet] Old is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigm, CVPR 2020. Code
8. [Any-Shot] Any-Shot Sequential Anomaly Detection in Surveillance Videos,CVPR 2020 workshop.
9. [Few-Shot]Few-Shot Scene-Adaptive Anomaly DetectionECCV 2020 Spotlight Code
10. [CDAE]Clustering-driven Deep Autoencoder for Video Anomaly DetectionECCV 2020

Weakly-Supervised

2018

1. [Sultani.etl] Real-world Anomaly Detection in Surveillance Videos, CVPR 2018 Code

2019

1. [GCN-Anomaly] Graph Convolutional Label Noise Cleaner:Train a Plug-and-play Action Classifier for Anomaly Detection, CVPR 2019, Code
2. [MLEP] Margin Learning Embedded Prediction for Video Anomaly Detection with A Few Anomalies, IJCAI 2019.
3. [IBL] Temporal Convolutional Network with Complementary Inner Bag Loss For Weakly Supervised Anomaly Detection. ICIP 19.
4. [Motion-Aware] Motion-Aware Feature for Improved Video Anomaly Detection. BMVC 19.

2020

1. [Siamese] Learning a distance function with a Siamese network to localize anomalies in videos, WACV 2020.
2. [AR-Net] Weakly Supervised Video Anomaly Detection via Center-Guided Discrimative Learning, ICME 2020.Code
3. Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervision ECCV 2020

Supervised

2019

1. [Background-Bias]Exploring Background-bias for Anomaly Detection in Surveillance Videos, ACM MM 19.
2. [Ano-Locality]Anomaly locality in video suveillance, ICIP 19.

Reviews / Surveys

1. An Overview of Deep Learning Based Methods for Unsupervised and Semi-Supervised Anomaly Detection in Videos, J. Image, 2018.page
2. DEEP LEARNING FOR ANOMALY DETECTION: A SURVEY, paper
3. Video Anomaly Detection for Smart Surveillance paper

Specific Scene

Traffic

CVPR 2018 workshop, CVPR 2019 workshop, AICity Challenge series.

First-Person Traffic

1. Unsupervised Traffic Accident Detection in First-Person Videos, IROS 2019.

Driving

When, Where, and What? A New Dataset for Anomaly Detection in Driving Videos. github

Fighting/Violence

1. Localization Guided Fight Action Detection in Survellance Videos. ICME 2019.

Social/ Group Anomaly

1. Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networks, Neurips 2019.

Related Topics

1. Video Representation (Unsupervised Video Representation, reconstruction, prediction etc.)
2. Object Detection
3. Pedestrian Detection
4. Skeleton Detection
5. Graph Neural Networks
6. GAN
7. Action Recongnition / Temporal Action Localization
8. Metric Learning
9. Label Noise Learning
10. Cross-Modal/ Multi-Modal
11. Dictionary Learning
12. One-Class Classification / Novelty Detection / Out-of-Disturibution Detection
13. Action Recognition.
    • Human in Events: A Large-Scale Benchmark for Human-centric Video Analysis in Complex Events. ACM MM 2020 workshop.

Performance

Performance Evaluation Methods

1. AUC
2. PR-AUC
3. Score Gap
4. False Alarm Rate on Normal with 0.5 as threshold (Weakly supervised, proposed in CVPR 18)

Performance Comparision on UCF-Crime

Perfromace Comparision on ShanghaiTech

Performance Comparision on Avenue

• Previous
  SinGAN
• Next
  Awesome Model Compression and Acceleration