Learn to cycle: Time-consistent feature discovery for action recognition

15 Jun 2020 Alexandros Stergiou Ronald Poppe

Generalizing over temporal variations is a prerequisite for effective action recognition in videos. Despite significant advances in deep neural networks, it remains a challenge to focus on short-term discriminative motions in relation to the overall performance of an action... (read more)

PDF Abstract

Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Action Recognition HACS SRTG r(2+1)d-50 Top 1 Accuracy 83.77 # 2
Top 5 Accuracy 96.56 # 2
Action Recognition HACS SRTG r(2+1)d-101 Top 1 Accuracy 84.33 # 1
Top 5 Accuracy 96.85 # 1
Action Recognition HACS SRTG r3d-34 Top 1 Accuracy 78.60 # 6
Top 5 Accuracy 93.57 # 6
Action Recognition HACS SRTG r3d-50 Top 1 Accuracy 80.36 # 5
Top 5 Accuracy 95.55 # 4
Action Recognition HACS SRTG r3d-101 Top 1 Accuracy 81.66 # 3
Top 5 Accuracy 96.33 # 3
Action Recognition HACS SRTG r(2+1)d-34 Top 1 Accuracy 80.39 # 4
Top 5 Accuracy 94.27 # 5
Action Classification Kinetics-700 SRTG r(2+1)d-50 Top-1 Accuracy 54.17 # 9
Top-5 Accuracy 74.62 # 2
Action Classification Kinetics-700 SRTG r3d-34 Top-1 Accuracy 49.15 # 12
Top-5 Accuracy 72.68 # 5
Action Classification Kinetics-700 SRTG r3d-50 Top-1 Accuracy 53.52 # 10
Top-5 Accuracy 74.17 # 3
Action Classification Kinetics-700 SRTG r(2+1)d-34 Top-1 Accuracy 49.43 # 11
Top-5 Accuracy 73.23 # 4
Action Classification Kinetics-700 SRTG r3d-101 Top-1 Accuracy 56.46 # 8
Top-5 Accuracy 76.82 # 1
Action Classification Moments in Time SRTG r(2+1)d-34 Top 1 Accuracy 28.97 # 16
Top 5 Accuracy 54.18 # 9
Action Classification Moments in Time SRTG r(2+1)d-50 Top 1 Accuracy 31.60 # 13
Top 5 Accuracy 56.80 # 6
Action Classification Moments in Time SRTG r3d-34 Top 1 Accuracy 28.55 # 17
Top 5 Accuracy 52.35 # 11
Action Classification Moments in Time SRTG r3d-101 Top 1 Accuracy 33.56 # 9
Top 5 Accuracy 58.49 # 5
Action Classification Moments in Time SRTG r3d-50 Top 1 Accuracy 30.72 # 14
Top 5 Accuracy 55.65 # 8

Methods used in the Paper


METHOD TYPE
Sigmoid Activation
Activation Functions
Tanh Activation
Activation Functions
LSTM
Recurrent Neural Networks