Search Results for author:
Found 21 papers, 8 papers with code
SpeechAct: Towards Generating Whole-body Motion from Speech
Then, we regress the motion representation from the audio signal by a translation model employing our contrastive motion learning method.
High-Quality Animatable Dynamic Garment Reconstruction from Monocular Videos
To alleviate the ambiguity estimating 3D garments from monocular videos, we design a multi-hypothesis deformation module that learns spatial representations of multiple plausible deformations.
Towards Grouping in Large Scenes with Occlusion-aware Spatio-temporal Transformers
To explore the potential spatio-temporal relationship, we propose spatio-temporal transformers to simultaneously extract trajectory information and fuse inter-person features in a hierarchical manner.
Narrator: Towards Natural Control of Human-Scene Interaction Generation via Relationship Reasoning
Also, we model global and local spatial relationships in a 3D scene and a textual description respectively based on the scene graph, and introduce a partlevel action mechanism to represent interactions as atomic body part states.
Out-of-Distribution Detection based on In-Distribution Data Patterns Memorization with Modern Hopfield Energy
In more detail, penultimate layer outputs on the training set are considered as the representations of in-distribution (ID) data.
Ranked #11 on
Out-of-Distribution Detection
on ImageNet-1k vs Places
Learning Semantic-Aware Disentangled Representation for Flexible 3D Human Body Editing
3D human body representation learning has received increasing attention in recent years.
DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysis
The rapid development of aspect-based sentiment analysis (ABSA) within recent decades shows great potential for real-world society.
Aspect-Based Sentiment Analysis
Aspect-Based Sentiment Analysis (ABSA)
+2
Text-Aware End-to-end Mispronunciation Detection and Diagnosis
In the field of assessing the pronunciation quality of constrained speech, the given transcriptions can play the role of a teacher.
High-Fidelity Human Avatars From a Single RGB Camera
To cope with the complexity of textures and generate photo-realistic results, we propose a reference-based neural rendering network and exploit a bottom-up sharpening-guided fine-tuning strategy to obtain detailed textures.
Advancing CTC-CRF Based End-to-End Speech Recognition with Wordpieces and Conformers
Automatic speech recognition systems have been largely improved in the past few decades and current systems are mainly hybrid-based and end-to-end-based.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Speech Enhancement using Separable Polling Attention and Global Layer Normalization followed with PReLU
With all these modifications, the size of the PHASEN model is shrunk from 33M parameters to 5M parameters, while the performance on VoiceBank+DEMAND is improved to the CSIG score of 4. 30, the PESQ score of 3. 07 and the COVL score of 3. 73.
A Full Text-Dependent End to End Mispronunciation Detection and Diagnosis with Easy Data Augmentation Techniques
Recently, end-to-end mispronunciation detection and diagnosis (MD&D) systems has become a popular alternative to greatly simplify the model-building process of conventional hybrid DNN-HMM systems by representing complicated modules with a single deep network architecture.
PISE: Person Image Synthesis and Editing with Decoupled GAN
The results of qualitative and quantitative experiments demonstrate the superiority of our model on human pose transfer.
Human Pose Transfer by Adaptive Hierarchical Deformation
Existing methods cannot effectively utilize the input information, which often fail to preserve the style and shape of hair and clothes.
PoNA: Pose-guided Non-local Attention for Human Pose Transfer
In each block, we propose a pose-guided non-local attention (PoNA) mechanism with a long-range dependency scheme to select more important regions of image features to transfer.
Adaptive 3D Face Reconstruction from a Single Image
3D face reconstruction from a single image is a challenging problem, especially under partial occlusions and extreme poses.
All-Weather Deep Outdoor Lighting Estimation
We use this network to label a large-scale dataset of LDR panoramas with lighting parameters and use them to train our single image outdoor lighting estimation network.
Deep Photovoltaic Nowcasting
Our experiments reveal that the MLP network, already used similarly in previous work, achieves an RMSE skill score of 7% over the commonly-used persistence baseline on the 1-minute future photovoltaic power prediction task.
Learning High Dynamic Range from Outdoor Panoramas
Outdoor lighting has extremely high dynamic range.
Phoneme Set Design Using English Speech Database by Japanese for Dialogue-Based English CALL Systems
This paper describes a method of generating a reduced phoneme set for dialogue-based computer assisted language learning (CALL)systems.
