About

Given a signed video input the task is to predict the (sequence of) sign(s) that are performed.

( Image credit: Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison )

Benchmarks

TREND DATASET BEST METHOD PAPER TITLE PAPER CODE COMPARE

Datasets

Latest papers without code

Evaluating the Immediate Applicability of Pose Estimation for Sign Language Recognition

20 Apr 2021

Basically, skeletal representations generalize over an individual's appearance and background, allowing us to focus on the recognition of motion.

POSE ESTIMATION SIGN LANGUAGE RECOGNITION

Visual Alignment Constraint for Continuous Sign Language Recognition

6 Apr 2021

Moreover, we further propose two metrics to evaluate the contributions of the feature extractor and the alignment model, which provide evidence for the overfitting problem.

SIGN LANGUAGE RECOGNITION

Continuous Sign Language Recognition through a Context-Aware Generative Adversarial Network

1 Apr 2021

The proposed network architecture consists of a generator that recognizes sign language glosses by extracting spatial and temporal features from video sequences, as well as a discriminator that evaluates the quality of the generator’s predictions by modeling text information at the sentence and gloss levels.

SIGN LANGUAGE RECOGNITION SIGN LANGUAGE TRANSLATION

Read and Attend: Temporal Localisation in Sign Language Videos

30 Mar 2021

Our contributions are as follows: (1) we demonstrate the ability to leverage large quantities of continuous signing videos with weakly-aligned subtitles to localise signs in continuous sign language; (2) we employ the learned attention to automatically generate hundreds of thousands of annotations for a large sign vocabulary; (3) we collect a set of 37K manually verified sign instances across a vocabulary of 950 sign classes to support our study of sign language recognition; (4) by training on the newly annotated data from our method, we outperform the prior state of the art on the BSL-1K sign language recognition benchmark.

SIGN LANGUAGE RECOGNITION

Sign Language Production: A Review

29 Mar 2021

Sign Language is the dominant yet non-primary form of communication language used in the deaf and hearing-impaired community.

SIGN LANGUAGE PRODUCTION SIGN LANGUAGE RECOGNITION

Efficient sign language recognition system and dataset creation method based on deep learning and image processing

22 Mar 2021

We achieved an accuracy of 96. 38% on the test set and 81. 36% on the validation set containing more challenging conditions, showing that 30 FPS is the best frame rate subsample to train the classifier, geometric transformations work better than intensity transformations, and artificial background creation is not effective to model generalization.

DATA AUGMENTATION OBJECT DETECTION SIGN LANGUAGE RECOGNITION SIGN LANGUAGE TRANSLATION

Pose-based Sign Language Recognition using GCN and BERT

1 Dec 2020

Recent pose-based architectures for WSLR either model both the spatial and temporal dependencies among the poses in different frames simultaneously or only model the temporal information without fully utilizing the spatial information.

SIGN LANGUAGE RECOGNITION

Independent Sign Language Recognition with 3D Body, Hands, and Face Reconstruction

24 Nov 2020

Independent Sign Language Recognition is a complex visual recognition problem that combines several challenging tasks of Computer Vision due to the necessity to exploit and fuse information from hand gestures, body features and facial expressions.

3D ACTION RECOGNITION 3D RECONSTRUCTION FACE RECONSTRUCTION OPTICAL FLOW ESTIMATION SIGN LANGUAGE RECOGNITION

Position and Rotation Invariant Sign Language Recognition from 3D Point Cloud Data with Recurrent Neural Networks

23 Oct 2020

It also serves as a communication bridge between non-impaired population and impaired population.

SIGN LANGUAGE RECOGNITION

American Sign Language Identification Using Hand Trackpoint Analysis

20 Oct 2020

We convert a hand gesture into a series of hand track point coordinates that serve as an input to our system.

LANGUAGE IDENTIFICATION SIGN LANGUAGE RECOGNITION