Search Results for author:
Found 20 papers, 2 papers with code
Mirror: Multimodal Cognitive Reframing Therapy for Rolling with Resistance
Recent studies have explored the use of large language models (LLMs) in psychotherapy; however, text-based cognitive behavioral therapy (CBT) models often struggle with client resistance, which can weaken therapeutic alliance.
REWIND: Real-Time Egocentric Whole-Body Motion Diffusion with Exemplar-Based Identity Conditioning
To enable real-time inference, we introduce (1) cascaded body-hand denoising diffusion, which effectively models the correlation between egocentric body and hand motions in a fast, feed-forward manner, and (2) diffusion distillation, which enables high-quality motion estimation with a single denoising step.
ORIGEN: Zero-Shot 3D Orientation Grounding in Text-to-Image Generation
We introduce ORIGEN, the first zero-shot method for 3D orientation grounding in text-to-image generation across multiple objects and diverse categories.
Keyword-Aware ASR Error Augmentation for Robust Dialogue State Tracking
Dialogue State Tracking (DST) is a key part of task-oriented dialogue systems, identifying important information in conversations.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+4
Inference is All You Need: Self Example Retriever for Cross-domain Dialogue State Tracking with ChatGPT
Traditional dialogue state tracking approaches heavily rely on extensive training data and handcrafted features, limiting their scalability and adaptability to new domains.
Dense Hand-Object(HO) GraspNet with Full Grasping Taxonomy and Dynamics
Accurate hand and object 3D meshes are obtained by fitting the hand parametric model (MANO) and the hand implicit function (HALO) to multi-view RGBD frames, with the MoCap system only for objects.
Prediction-Feedback DETR for Temporal Action Detection
Temporal Action Detection (TAD) is fundamental yet challenging for real-world video applications.
InterHandGen: Two-Hand Interaction Generation via Cascaded Reverse Diffusion
Sampling from our model yields plausible and diverse two-hand shapes in close interaction with or without an object.
BrainTalker: Low-Resource Brain-to-Speech Synthesis with Transfer Learning using Wav2Vec 2.0
Specifically, we train an encoder module to map ECoG signals to latent embeddings that match Wav2Vec 2. 0 representations of the corresponding spoken speech.
Style Modeling for Multi-Speaker Articulation-to-Speech
In this paper, we propose a neural articulation-to-speech (ATS) framework that synthesizes high-quality speech from articulatory signal in a multi-speaker situation.
Exploring the Viability of Synthetic Audio Data for Audio-Based Dialogue State Tracking
We address this by investigating synthetic audio data for audio-based DST.
DORIC : Domain Robust Fine-Tuning for Open Intent Clustering through Dependency Parsing
We present our work on Track 2 in the Dialog System Technology Challenges 11 (DSTC11).
Im2Hands: Learning Attentive Implicit Representation of Interacting Two-Hand Shapes
To handle the shape complexity and interaction context between two hands, Im2Hands models the occupancy volume of two hands - conditioned on an RGB image and coarse 3D keypoints - by two novel attention-based modules responsible for (1) initial occupancy estimation and (2) context-aware occupancy refinement, respectively.
Self-Training with Purpose Preserving Augmentation Improves Few-shot Generative Dialogue State Tracking
In dialogue state tracking (DST), labeling the dataset involves considerable human labor.
SF-DST: Few-Shot Self-Feeding Reading Comprehension Dialogue State Tracking with Auxiliary Task
Few-shot dialogue state tracking (DST) model tracks user requests in dialogue with reliable accuracy even with a small amount of data.
Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian
We propose a framework that can deform an object in a 2D image as it exists in 3D space.
Facetron: A Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representations
In this paper, we propose a multi-speaker face-to-speech waveform generation model that also works for unseen speaker conditions.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
Fast DCTTS: Efficient Deep Convolutional Text-to-Speech
We propose an end-to-end speech synthesizer, Fast DCTTS, that synthesizes speech in real time on a single CPU thread.
Learning Monotonic Alignments with Source-Aware GMM Attention
Transformers with soft attention have been widely adopted to various sequence-to-sequence tasks.
