Sign Language Production
8 papers with code • 0 benchmarks • 3 datasets
Sign Language Production (SLP) is the automatically translation from spoken language sentences into sign language sequences. Whilst Sign language Translation translates from sign to text, SLP is the opposite task from text to sign.
Benchmarks
These leaderboards are used to track progress in Sign Language Production
How2Sign
LSFB Datasets
Mediapi-RGB
Most implemented papers
Progressive Transformers for End-to-End Sign Language Production
BenSaunders27/ProgressiveTransformersSLP
•
•
ECCV 2020
The goal of automatic Sign Language Production (SLP) is to translate spoken language to a continuous stream of sign language video at a level comparable to a human translator.
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language
Towards this end, we introduce How2Sign, a multimodal and multiview continuous American Sign Language (ASL) dataset, consisting of a parallel corpus of more than 80 hours of sign language videos and a set of corresponding modalities including speech, English transcripts, and depth.
Sign Language Production: A Review
Sign Language is the dominant yet non-primary form of communication language used in the deaf and hearing-impaired community.
Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production
To learn sign co-articulation, we propose a novel Frame Selection Network (FS-Net) that improves the temporal alignment of interpolated dictionary signs to continuous signing sequences.
A Data-Driven Representation for Sign Language Production
By applying Vector Quantisation (VQ) to sign language data, we first learn a codebook of short motions that can be combined to create a natural sequence of sign.
Sign Stitching: A Novel Approach to Sign Language Production
Then by applying filtering in the frequency domain and resampling each sign we create cohesive natural sequences, that mimic the prosody found in the original data.
Empowering Sign Language Communication: Integrating Sentiment and Semantics for Facial Expression Synthesis
verlab/empowering-sign-language
•
•
Facial expressions (non-manual), in particular, are responsible for encoding the grammar of the sentence to be spoken, applying punctuation, pronouns, or emphasizing signs.
Sign-IDD: Iconicity Disentangled Diffusion for Sign Language Production
Sign-IDD incorporates a novel Iconicity Disentanglement (ID) module to bridge the gap between relative positions among joints.
