Search Results for author:
Found 6 papers, 0 papers with code
Music-driven Dance Regeneration with Controllable Key Pose Constraints
The cross-modal transformer decoder achieves the capability of synthesizing smooth dance motion sequences, which keeps a consistency with key poses at corresponding positions, by introducing the local neighbor position embedding.
Learning Music-Dance Representations through Explicit-Implicit Rhythm Synchronization
Although audio-visual representation has been proved to be applicable in many downstream tasks, the representation of dancing videos, which is more specific and always accompanied by music with complex auditory contents, remains challenging and uninvestigated.
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation
Finally, the synthetic parallel data serves as a strong supplement for the end-to-end training of the encoder-decoder SLT framework.
Ranked #4 on
Sign Language Translation
on CSL-Daily
Boosting Continuous Sign Language Recognition via Cross Modality Augmentation
Continuous sign language recognition (SLR) deals with unaligned video-text pair and uses the word error rate (WER), i. e., edit distance, as the main evaluation metric.
Global-local Enhancement Network for NMFs-aware Sign Language Recognition
Sign language recognition (SLR) is a challenging problem, involving complex manual features, i. e., hand gestures, and fine-grained non-manual features (NMFs), i. e., facial expression, mouth shapes, etc.
Iterative Alignment Network for Continuous Sign Language Recognition
Our framework consists of two modules: a 3D convolutional residual network (3D-ResNet) for feature learning and an encoder-decoder network with connectionist temporal classification (CTC) for sequence modelling.
