About
Given a video containing sign language, the task is to predict the translation into (written) spoken language.
Benchmarks
| TREND | DATASET | BEST METHOD | PAPER TITLE | PAPER | CODE | COMPARE |
|---|---|---|---|---|---|---|
|
||||||
|
Datasets
Greatest papers with code
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation
Sign language translation (SLT) aims to interpret sign video sequences into text-based natural language sentences.
SIGN LANGUAGE RECOGNITION SIGN LANGUAGE TRANSLATION VIDEO SEGMENTATION VIDEO SEMANTIC SEGMENTATION
Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison
Based on this new large-scale dataset, we are able to experiment with several deep learning methods for word-level sign recognition and evaluate their performances in large scale scenarios.
ACTION CLASSIFICATION HAND GESTURE RECOGNITION SIGN LANGUAGE RECOGNITION SIGN LANGUAGE TRANSLATION
Neural Sign Language Translation
CVPR 2018
• neccam/nslt
• 
SLR seeks to recognize a sequence of continuous signs but neglects the underlying rich grammatical and linguistic structures of sign language that differ from spoken language.
4 GESTURE RECOGNITION LANGUAGE MODELLING MACHINE TRANSLATION SIGN LANGUAGE RECOGNITION SIGN LANGUAGE TRANSLATION TOKENIZATION
Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation
CVPR 2020
• neccam/slt
• 
We report state-of-the-art sign language recognition and translation results achieved by our Sign Language Transformers.
4 SIGN LANGUAGE RECOGNITION SIGN LANGUAGE TRANSLATION TOKENIZATION
Better Sign Language Translation with STMC-Transformer
arXiv preprint 2020
• kayoyin/transformer-slt
•
This contradicts previous claims that GT gloss translation acts as an upper bound for SLT performance and reveals that glosses are an inefficient representation of sign language.
Ranked #1 on
Sign Language Translation
on ASLG-PC12