About

Given a signed video input the task is to predict the (sequence of) sign(s) that are performed.

( Image credit: Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison )

Benchmarks

TREND DATASET BEST METHOD PAPER TITLE PAPER CODE COMPARE

Datasets

Latest papers with code

Skeleton Aware Multi-modal Sign Language Recognition

16 Mar 2021jackyjsy/CVPR21Chal-SLR

Sign language is commonly used by deaf or speech impaired people to communicate but requires significant effort to master.

 Ranked #1 on Sign Language Recognition on AUTSL (using extra training data)

SIGN LANGUAGE RECOGNITION SKELETON BASED ACTION RECOGNITION

31
16 Mar 2021

Application of Transfer Learning to Sign Language Recognition using an Inflated 3D Deep Convolutional Neural Network

25 Feb 2021rtoengi/transfer-learning-for-sign-language-recognition

Transfer learning is implemented by pre-training a network on the American Sign Language dataset MS-ASL and subsequently fine-tuning it separately on three different sizes of the German Sign Language dataset SIGNUM.

SIGN LANGUAGE RECOGNITION TRANSFER LEARNING

0
25 Feb 2021

Context Matters: Self-Attention for Sign Language Recognition

12 Jan 2021faresbs/san

For that reason, we apply attention to synchronize and help capture entangled dependencies between the different sign language components.

SIGN LANGUAGE RECOGNITION

8
12 Jan 2021

Quantitative Survey of the State of the Art in Sign Language Recognition

22 Aug 2020oskoller/sign-language-state-of-the-art

This work presents a meta study covering around 300 published sign language recognition papers with over 400 experimental results.

SIGN LANGUAGE RECOGNITION

8
22 Aug 2020

A Comprehensive Study on Deep Learning-based Methods for Sign Language Recognition

24 Jul 2020black0017/black0017

In this paper, a comparative experimental assessment of computer vision-based methods for sign language recognition is conducted.

SCENE TEXT SCENE TEXT RECOGNITION SIGN LANGUAGE RECOGNITION

0
24 Jul 2020

BSL-1K: Scaling up co-articulated sign language recognition using mouthing cues

ECCV 2020 gulvarol/bsl1k

Recent progress in fine-grained gesture and action classification, and machine translation, point to the possibility of automated sign language recognition becoming a reality.

ACTION CLASSIFICATION ACTION CLASSIFICATION KEYWORD SPOTTING MACHINE TRANSLATION SIGN LANGUAGE RECOGNITION

33
23 Jul 2020

BlazePose: On-device Real-time Body Pose tracking

17 Jun 2020VNOpenAI/tf-blazepose

We present BlazePose, a lightweight convolutional neural network architecture for human pose estimation that is tailored for real-time inference on mobile devices.

POSE ESTIMATION POSE TRACKING SIGN LANGUAGE RECOGNITION

44
17 Jun 2020

Better Sign Language Translation with STMC-Transformer

arXiv preprint 2020 kayoyin/transformer-slt

This contradicts previous claims that GT gloss translation acts as an upper bound for SLT performance and reveals that glosses are an inefficient representation of sign language.

SIGN LANGUAGE RECOGNITION SIGN LANGUAGE TRANSLATION

66
01 Apr 2020

Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation

CVPR 2020 neccam/slt

We report state-of-the-art sign language recognition and translation results achieved by our Sign Language Transformers.

SIGN LANGUAGE RECOGNITION SIGN LANGUAGE TRANSLATION TOKENIZATION

78
30 Mar 2020