Search Results for author:
Found 23 papers, 10 papers with code
Does My Dog ''Speak'' Like Me? The Acoustic Correlation between Pet Dogs and Their Human Owners
How hosts language influence their pets' vocalization is an interesting yet underexplored problem.
Towards Lexical Analysis of Dog Vocalizations via Online Videos
This study presents a data-driven investigation into the semantics of dog vocalizations via correlating different sound types with consistent semantics.
A Large-scale Dataset for Audio-Language Representation Learning
To tackle these challenges, we present an innovative and automatic audio caption generation pipeline based on a series of public tools or APIs, and construct a large-scale, high-quality, audio-language dataset, named as Auto-ACD, comprising over 1. 9M audio-text pairs.
Improving Audio Caption Fluency with Automatic Error Correction
Automated audio captioning (AAC) is an important cross-modality translation task, aiming at generating descriptions for audio clips.
LLM-empowered Chatbots for Psychiatrist and Patient Simulation: Application and Evaluation
Empowering chatbots in the field of mental health is receiving increasing amount of attention, while there still lacks exploration in developing and evaluating chatbots in psychiatric outpatient scenarios.
Semantic Space Grounded Weighted Decoding for Multi-Attribute Controllable Dialogue Generation
Controlling chatbot utterance generation with multiple attributes such as personalities, emotions and dialogue acts is a practically useful but under-studied problem.
OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue
The second phase is to fine-tune the pretrained model on the TOD data.
DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning
In this work, we aim to build a unified dialogue foundation model (DFM) which can be used to solve massive diverse dialogue tasks.
D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chat
In a depression-diagnosis-directed clinical session, doctors initiate a conversation with ample emotional support that guides the patients to expose their symptoms based on clinical diagnosis criteria.
Symptom Identification for Interpretable Detection of Multiple Mental Disorders
Mental disease detection (MDD) from social media has suffered from poor generalizability and interpretability, due to lack of symptom modeling.
Psychiatric Scale Guided Risky Post Screening for Early Detection of Depression
Depression is a prominent health challenge to the world, and early risk detection (ERD) of depression from online posts can be a promising technique for combating the threat.
Climate and Weather: Inspecting Depression Detection via Emotion Recognition
Automatic depression detection has attracted increasing amount of attention but remains a challenging task.
Audio-text Retrieval in Context
Using pre-trained audio features and a descriptor-based aggregation method, we build our contextual audio-text retrieval system.
Can Audio Captions Be Evaluated with Image Caption Metrics?
Current metrics are found in poor correlation with human annotations on these datasets.
THE SJTU SYSTEM FOR DCASE2021 CHALLENGE TASK 6: AUDIO CAPTIONING BASED ON ENCODER PRE-TRAINING AND REINFORCEMENT LEARNING
This report proposes an audio captioning system for the Detection and Classification of Acoustic Scenes and Events (DCASE) 2021 challenge task Task 6.
Ranked #2 on
Audio captioning
on Clotho
(using extra training data)
Decoupled Dialogue Modeling and Semantic Parsing for Multi-Turn Text-to-SQL
A dual learning approach is also proposed for the utterance rewrite model to address the data sparsity problem.
Towards duration robust weakly supervised sound event detection
Our model outperforms other approaches on the DCASE2018 and URBAN-SED datasets without requiring prior duration knowledge.
Data Augmentation
Sound Event Detection
Sound
Audio and Speech Processing
Multiple Sound Sources Localization from Coarse to Fine
How to visually localize multiple sound sources in unconstrained videos is a formidable problem, especially when lack of the pairwise sound-object annotations.
Building Interpretable Interaction Trees for Deep NLP Models
This paper proposes a method to disentangle and quantify interactions among words that are encoded inside a DNN for natural language processing.
Voice activity detection in the wild via weakly supervised sound event detection
We proposed two GPVAD models, one full (GPV-F), trained on 527 Audioset sound events, and one binary (GPV-B), only distinguishing speech and noise.
Sound Audio and Speech Processing
Audio Caption in a Car Setting with a Sentence-Level Loss
Captioning has attracted much attention in image and video understanding while a small amount of work examines audio captioning.
Text-based depression detection on sparse data
Previous text-based depression detection is commonly based on large user-generated data.
Audio Caption: Listen and Tell
A baseline encoder-decoder model is provided for both English and Mandarin.
