Investigating the dynamics of hand and lips in French Cued Speech using attention mechanisms and CTC-based decoding

no code implementations • 14 Jun 2023 • Sanjana Sankar, Denis Beautemps, Frédéric Elisei, Olivier Perrotin, Thomas Hueber

Along with the release of this dataset, a benchmark will be reported for word-level recognition, a novelty in the automatic recognition of French CS.

Lipreading

Multistream neural architectures for cued-speech recognition using a pre-trained visual feature extractor and constrained CTC decoding

no code implementations • 11 Apr 2022 • Sanjana Sankar, Denis Beautemps, Thomas Hueber

This paper proposes a simple and effective approach for automatic recognition of Cued Speech (CS), a visual communication tool that helps people with hearing impairment to understand spoken language with the help of hand gestures that can uniquely identify the uttered phonemes in complement to lipreading.

Lipreading speech-recognition +1

Extraction automatique de contour de l\`evre \`a partir du mod\`ele CLNF (Automatic lip contour extraction using CLNF model)

no code implementations • JEPTALNRECITAL 2016 • Li Liu, Gang Feng, Denis Beautemps

Dans cet article nous proposons une nouvelle solution pour extraire le contour interne des l{\`e}vres d{'}un locuteur sans utiliser d{'}artifices.

Influence de l'expansion des joues lors de la production d'une plosive bilabiale (Influence of the cheeks expansion during bilabial plosive production) [in French]

no code implementations • JEPTALNRECITAL 2012 • Louis Delebecque, Xavier Pelorson, Denis Beautemps, Balbine Maillou, Christophe Savariaux, Xavier Laval

Mapping de l'espace spectral vers l'espace visuel de la parole : les voyelles du fran\ccais en langue fran\ccaise parl\'ee compl\'et\'ee (Mapping of the spectral space to the visual speech space for French vowels cued in Cued Speech) [in French]

no code implementations • JEPTALNRECITAL 2012 • Zuheng Ming, Gang Feng, Denis Beautemps