Zero-Shot Action Recognition
34 papers with code • 7 benchmarks • 6 datasets
Benchmarks
These leaderboards are used to track progress in Zero-Shot Action Recognition
Libraries
Use these libraries to find Zero-Shot Action Recognition models and implementations
UCF101
Kinetics
HMDB51
ActivityNet
Charades
THUMOS14
Most implemented papers
Expanding Language-Image Pretrained Models for General Video Recognition
microsoft/videox
•
•
Extensive experiments demonstrate that our approach is effective and can be generalized to different video recognition scenarios.
An embarrassingly simple approach to zero-shot learning
Zero-shot learning consists in learning how to recognise new concepts by just having a description of them.
Cross-Modal and Hierarchical Modeling of Video and Text
Similarly, a paragraph may contain sentences with different topics, which collectively conveys a coherent message or story.
Out-of-Distribution Detection for Generalized Zero-Shot Action Recognition
We introduce an out-of-distribution detector that determines whether the video features belong to a seen or unseen action category.
I Know the Relationships: Zero-Shot Action Recognition via Two-Stream Graph Convolutional Networks and Knowledge Graphs
junyuGao/Zero-Shot-Action-Recognition-with-Two-Stream-GCN
•
•
Proceedings of the AAAI Conference on Artificial Intelligence 2019
To effectively leverage the knowledge graph, we design a novel Two-Stream Graph Convolutional Network (TS-GCN) consisting of a classifier branch and an instance branch.
Learning Spatiotemporal Features via Video and Text Pair Discrimination
In addition, our CPD model yields a new state of the art for zero-shot action recognition on UCF101 by directly utilizing the learnt visual-textual embeddings.
Rethinking Zero-shot Video Classification: End-to-end Training for Realistic Applications
bbrattoli/ZeroShotVideoClassification
•
•
CVPR 2020
Our training procedure builds on insights from recent video classification literature and uses a trainable 3D CNN to learn the visual features.
A New Split for Evaluating True Zero-Shot Action Recognition
We benchmark several recent approaches on the proposed True Zero-Shot(TruZe) Split for UCF101 and HMDB51, with zero-shot and generalized zero-shot evaluation.
Elaborative Rehearsal for Zero-shot Action Recognition
DeLightCMU/ElaborativeRehearsal
•
•
ICCV 2021
However, due to the complexity and diversity of actions, it remains challenging to semantically represent action classes and transfer knowledge from seen data.
Zero-Shot Action Recognition from Diverse Object-Scene Compositions
carlobretti/object-scene-compositions-for-actions
•
•
This paper investigates the problem of zero-shot action recognition, in the setting where no training videos with seen actions are available.
