Sign Language Translation
34 papers with code • 5 benchmarks • 13 datasets
Given a video containing sign language, the task is to predict the translation into (written) spoken language.
Image credit: How2Sign
Benchmarks
These leaderboards are used to track progress in Sign Language Translation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
Datasets
WLASL
How2Sign
OpenASL
BosphorusSign22k
Content4All
WMT-SLT
ASLG-PC12
Most implemented papers
A Token-level Contrastive Framework for Sign Language Translation
biaofuxmu/conslt
•
•
Sign Language Translation (SLT) is a promising technology to bridge the communication gap between the deaf and the hearing people.
Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data Augmentation
yongcaoplus/tin-slt
•
•
Findings (NAACL) 2022
Sign language recognition and translation first uses a recognition module to generate glosses from sign language videos and then employs a translation module to translate glosses into spoken sentences.
Open-Domain Sign Language Translation Learned from Online Video
Existing work on sign language translation - that is, translation from sign language videos into sentences in a written language - has focused mainly on (1) data collected in a controlled environment or (2) data in a specific domain, which limits the applicability to real-world settings.
Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting
j22melody/signwriting-translation
•
•
This paper presents work on novel machine translation (MT) systems between spoken and signed languages, where signed languages are represented in SignWriting, a sign language writing system.
Two-Stream Network for Sign Language Recognition and Translation
FangyunWei/SLRT
•
•
RGB videos, however, are raw signals with substantial visual redundancy, leading the encoder to overlook the key information for sign language understanding.
LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language Translation
midusi/lsa-t
•
•
Sign language translation (SLT) is an active field of study that encompasses human-computer interaction, computer vision, natural language processing and machine learning.
Tackling Low-Resourced Sign Language Translation: UPC at WMT-SLT 22
mt-upc/fairseq
•
•
This paper describes the system developed at the Universitat Polit\`ecnica de Catalunya for the Workshop on Machine Translation 2022 Sign Language Translation Task, in particular, for the sign-to-text direction.
A comparison of small sample methods for Handshape Recognition
midusi/cacic2019-handshapes
•
•
Journal of Computer Science and Technology (JCST) 2023
We compare a series of models specially tailored for small datasets to improve their performance on handshape recognition tasks.
Sign Language Translation from Instructional Videos
imatge-upc/slt_how2sign_wicv2023
•
•
We report a result of 8. 03 on the BLEU score, and publish the first open-source implementation of its kind to promote further advances.
Better Sign Language Translation with Monolingual Data
pengr/mono_slt
•
•
Sign language translation (SLT) systems, which are often decomposed into video-to-gloss (V2G) recognition and gloss-to-text (G2T) translation through the pivot gloss, heavily relies on the availability of large-scale parallel G2T pairs.
