Search Results for author: Jihyun Lee

Found 13 papers, 2 papers with code

Im2Hands: Learning Attentive Implicit Representation of Interacting Two-Hand Shapes

1 code implementation CVPR 2023 Jihyun Lee, Minhyuk Sung, Honggyu Choi, Tae-Kyun Kim

To handle the shape complexity and interaction context between two hands, Im2Hands models the occupancy volume of two hands - conditioned on an RGB image and coarse 3D keypoints - by two novel attention-based modules responsible for (1) initial occupancy estimation and (2) context-aware occupancy refinement, respectively.

Image Reconstruction Vocal Bursts Valence Prediction

Fast DCTTS: Efficient Deep Convolutional Text-to-Speech

no code implementations1 Apr 2021 Minsu Kang, Jihyun Lee, Simin Kim, Injung Kim

We propose an end-to-end speech synthesizer, Fast DCTTS, that synthesizes speech in real time on a single CPU thread.

Computational Efficiency

SF-DST: Few-Shot Self-Feeding Reading Comprehension Dialogue State Tracking with Auxiliary Task

no code implementations16 Sep 2022 Jihyun Lee, Gary Geunbae Lee

Few-shot dialogue state tracking (DST) model tracks user requests in dialogue with reliable accuracy even with a small amount of data.

Dialogue State Tracking Reading Comprehension

BrainTalker: Low-Resource Brain-to-Speech Synthesis with Transfer Learning using Wav2Vec 2.0

no code implementations21 Dec 2023 Miseul Kim, Zhenyu Piao, Jihyun Lee, Hong-Goo Kang

Specifically, we train an encoder module to map ECoG signals to latent embeddings that match Wav2Vec 2. 0 representations of the corresponding spoken speech.

Speech Synthesis Transfer Learning

Style Modeling for Multi-Speaker Articulation-to-Speech

no code implementations21 Dec 2023 Miseul Kim, Zhenyu Piao, Jihyun Lee, Hong-Goo Kang

In this paper, we propose a neural articulation-to-speech (ATS) framework that synthesizes high-quality speech from articulatory signal in a multi-speaker situation.

InterHandGen: Two-Hand Interaction Generation via Cascaded Reverse Diffusion

no code implementations26 Mar 2024 Jihyun Lee, Shunsuke Saito, Giljoo Nam, Minhyuk Sung, Tae-Kyun Kim

Sampling from our model yields plausible and diverse two-hand shapes in close interaction with or without an object.

Cannot find the paper you are looking for? You can Submit a new open access paper.