Gloss-free Sign Language Translation
8 papers with code • 6 benchmarks • 8 datasets
Benchmarks
These leaderboards are used to track progress in Gloss-free Sign Language Translation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Datasets
RWTH-PHOENIX-Weather 2014 T
How2Sign
OpenASL
Mediapi-RGB
DailyMoth-70h
Most implemented papers
Open-Domain Sign Language Translation Learned from Online Video
Existing work on sign language translation - that is, translation from sign language videos into sentences in a written language - has focused mainly on (1) data collected in a controlled environment or (2) data in a specific domain, which limits the applicability to real-world settings.
Gloss-Free End-to-End Sign Language Translation
In this paper, we tackle the problem of sign language translation (SLT) without gloss annotations.
Gloss Attention for Gloss-free Sign Language Translation
yinaoxiong/gaslt
•
•
CVPR 2023
We find that it can provide two aspects of information for the model, 1) it can help the model implicitly learn the location of semantic boundaries in continuous sign language videos, 2) it can help the model understand the sign language video globally.
Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining
zhoubenjia/gfslt-vlp
•
•
ICCV 2023
Many previous methods employ an intermediate representation, i. e., gloss sequences, to facilitate SLT, thus transforming it into a two-stage task of sign language recognition (SLR) followed by sign language translation (SLT).
Towards Privacy-Aware Sign Language Translation at Scale
A major impediment to the advancement of sign language translation (SLT) is data scarcity.
Improving Gloss-free Sign Language Translation by Reducing Representation Density
jinhuiye/signcl
•
•
In this paper, we identify a representation density problem that could be a bottleneck in restricting the performance of gloss-free SLT.
Signformer is all you need: Towards Edge AI for Sign Language
Sign language translation, especially in gloss-free paradigm, is confronting a dilemma of impracticality and unsustainability due to growing resource-intensive methodologies.
Uni-Sign: Toward Unified Sign Language Understanding at Scale
Sign language pre-training has gained increasing attention for its ability to enhance performance across various sign language understanding (SLU) tasks.
