Search Results for author: Zifan Jiang

Found 9 papers, 7 papers with code

Pose-Based Sign Language Appearance Transfer

1 code implementation17 Oct 2024 Amit Moryossef, Gerard Sant, Zifan Jiang

We introduce a method for transferring the signer's appearance in sign language skeletal poses while preserving the sign content.

SignCLIP: Connecting Text and Sign Language by Contrastive Learning

1 code implementation1 Jul 2024 Zifan Jiang, Gerard Sant, Amit Moryossef, Mathias Müller, Rico Sennrich, Sarah Ebling

We present SignCLIP, which re-purposes CLIP (Contrastive Language-Image Pretraining) to project spoken language text and sign language videos, two classes of natural languages of distinct modalities, into the same space.

Contrastive Learning Sign Language Recognition +2

SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language Models

2 code implementations20 Sep 2023 Amit Moryossef, Zifan Jiang

We introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing system.

Machine Translation Sign Language Translation +1

Automatic Sound Event Detection and Classification of Great Ape Calls Using Neural Networks

1 code implementation5 Jan 2023 Zifan Jiang, Adrian Soldati, Isaac Schamberg, Adriano R. Lameira, Steven Moran

We present a novel approach to automatically detect and classify great ape calls from continuous raw audio recordings collected during field research.

Event Detection Sound Event Detection

Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting

1 code implementation11 Oct 2022 Zifan Jiang, Amit Moryossef, Mathias Müller, Sarah Ebling

This paper presents work on novel machine translation (MT) systems between spoken and signed languages, where signed languages are represented in SignWriting, a sign language writing system.

Machine Translation Sign Language Translation +1

Privacy-Preserving Eye-tracking Using Deep Learning

no code implementations17 Jun 2021 Salman Seyedi, Zifan Jiang, Allan Levey, Gari D. Clifford

The expanding usage of complex machine learning methods like deep learning has led to an explosion in human activity recognition, particularly applied to health.

Deep Learning Human Activity Recognition +3

Cannot find the paper you are looking for? You can Submit a new open access paper.