Search Results for author: Hang Chen

Found 25 papers, 5 papers with code

The Multimodal Information Based Speech Processing (MISP) 2023 Challenge: Audio-Visual Target Speaker Extraction

no code implementations15 Sep 2023 Shilong Wu, Chenxi Wang, Hang Chen, Yusheng Dai, Chenyue Zhang, Ruoyu Wang, Hongbo Lan, Jun Du, Chin-Hui Lee, Jingdong Chen, Shinji Watanabe, Sabato Marco Siniscalchi, Odette Scharenborg, Zhong-Qiu Wang, Jia Pan, Jianqing Gao

This pioneering effort aims to set the first benchmark for the AVTSE task, offering fresh insights into enhancing the ac-curacy of back-end speech recognition systems through AVTSE in challenging and real acoustic environments.

Audio-Visual Speech Recognition speech-recognition +2

The USTC-NERCSLIP Systems for the CHiME-7 DASR Challenge

no code implementations28 Aug 2023 Ruoyu Wang, Maokui He, Jun Du, Hengshun Zhou, Shutong Niu, Hang Chen, Yanyan Yue, Gaobin Yang, Shilong Wu, Lei Sun, Yanhui Tu, Haitao Tang, Shuangqing Qian, Tian Gao, Mengzhi Wang, Genshun Wan, Jia Pan, Jianqing Gao, Chin-Hui Lee

This technical report details our submission system to the CHiME-7 DASR Challenge, which focuses on speaker diarization and speech recognition under complex multi-speaker settings.

speaker-diarization Speaker Diarization +2

Semi-supervised multi-channel speaker diarization with cross-channel attention

no code implementations17 Jul 2023 Shilong Wu, Jun Du, Maokui He, Shutong Niu, Hang Chen, Haitao Tang, Chin-Hui Lee

Most neural speaker diarization systems rely on sufficient manual training data labels, which are hard to collect under real-world scenarios.

speaker-diarization Speaker Diarization

Learning a Structural Causal Model for Intuition Reasoning in Conversation

no code implementations28 May 2023 Hang Chen, Bingyu Liao, Jing Luo, Wenjing Zhu, Xinyu Yang

Reasoning, a crucial aspect of NLP research, has not been adequately addressed by prevailing models including Large Language Model.

Causal Discovery Language Modelling +2

On the Importance of Backbone to the Adversarial Robustness of Object Detectors

no code implementations27 May 2023 Xiao Li, Hang Chen, Xiaolin Hu

We argue that using adversarially pre-trained backbone networks is essential for enhancing the adversarial robustness of object detectors.

Adversarial Robustness Autonomous Driving +2

Affective Reasoning at Utterance Level in Conversations: A Causal Discovery Approach

no code implementations4 May 2023 Hang Chen, Jing Luo, Xinyu Yang, Wenjing Zhu

It is a novel causal discovery method showing how to discover causal relationships in a conversation via designing a common skeleton and generating a substitute for implicit causes.

Causal Discovery Emotion-Cause Pair Extraction +1

Towards Causal Representation Learning and Deconfounding from Indefinite Data

no code implementations4 May 2023 Hang Chen, Xinyu Yang, Qing Yang

We implement the above designs as a dynamic variational inference model, tailored to learn causal representation from indefinite data under latent confounding.

Causal Discovery Disentanglement +1

An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuits

1 code implementation21 Dec 2022 Kai Li, Fenghua Xie, Hang Chen, Kexin Yuan, Xiaolin Hu

Then, inspired by the large number of connections between cortical regions and the thalamus, the model fuses the auditory and visual information in a thalamic subnetwork through top-down connections.

Speech Separation

Dual adaptive training of photonic neural networks

1 code implementation9 Dec 2022 Ziyang Zheng, Zhengyang Duan, Hang Chen, Rui Yang, Sheng Gao, Haiou Zhang, Hongkai Xiong, Xing Lin

Photonic neural network (PNN) is a remarkable analog artificial intelligence (AI) accelerator that computes with photons instead of electrons to feature low latency, high energy efficiency, and high parallelism.

Image Classification

Optical multi-task learning using multi-wavelength diffractive deep neural networks

no code implementations30 Nov 2022 Zhengyang Duan, Hang Chen, Xing Lin

By encoding multi-task inputs into multi-wavelength channels, the system can increase the computing throughput and significantly alle-viate the competition to perform multiple tasks in parallel with high accuracy.

Multi-Task Learning

Deep Learning Based Audio-Visual Multi-Speaker DOA Estimation Using Permutation-Free Loss Function

no code implementations26 Oct 2022 Qing Wang, Hang Chen, Ya Jiang, Zhe Wang, Yuyang Wang, Jun Du, Chin-Hui Lee

In this paper, we propose a deep learning based multi-speaker direction of arrival (DOA) estimation with audio and visual signals by using permutation-free loss function.

Optical Neural Ordinary Differential Equations

no code implementations26 Sep 2022 Yun Zhao, Hang Chen, Min Lin, Haiou Zhang, Tao Yan, Xing Lin, Ruqi Huang, Qionghai Dai

Increasing the layer number of on-chip photonic neural networks (PNNs) is essential to improve its model performance.

Image Classification Trajectory Prediction

A Review and Roadmap of Deep Learning Causal Discovery in Different Variable Paradigms

no code implementations14 Sep 2022 Hang Chen, Keqing Du, Xinyu Yang, Chenguang Li

Understanding causality helps to structure interventions to achieve specific goals and enables predictions under interventions.

Causal Discovery

Learning a General Clause-to-Clause Relationships for Enhancing Emotion-Cause Pair Extraction

no code implementations29 Aug 2022 Hang Chen, Xinyu Yang, Xiang Li

To learn it applicably, we propose a general clause-level encoding model named EA-GAT comprising E-GAT and Activation Sort.

Emotion-Cause Pair Extraction

Robust Blockchained Federated Learning with Model Validation and Proof-of-Stake Inspired Consensus

1 code implementation9 Jan 2021 Hang Chen, Syed Ali Asif, Jihong Park, Chien-Chung Shen, Mehdi Bennis

Federated learning (FL) is a promising distributed learning solution that only exchanges model parameters without revealing raw data.

Federated Learning

Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention

no code implementations28 Dec 2020 Hang Chen, Jun Du, Yu Hu, Li-Rong Dai, Chin-Hui Lee, Bao-Cai Yin

In this paper, we propose a novel deep learning architecture to improving word-level lip-reading.

Lip Reading

Modified EP MIMO Detection Algorithm with Deep Learning Parameters Selection

no code implementations19 Oct 2020 Hang Chen, Guoqiang Yao, Jianhao Hu

According to the influence of the moment matching and parameter selection for the performance of the EP MIMO detector, we propose a modified EP MIMO detector (MEPD).

Correlating Subword Articulation with Lip Shapes for Embedding Aware Audio-Visual Speech Enhancement

no code implementations21 Sep 2020 Hang Chen, Jun Du, Yu Hu, Li-Rong Dai, Bao-Cai Yin, Chin-Hui Lee

We first extract visual embedding from lip frames using a pre-trained phone or articulation place recognizer for visual-only EASE (VEASE).

Speech Enhancement

What does the language of foods say about us?

no code implementations WS 2019 Hoang Van, Ahmad Musa, Hang Chen, Stephen Kobourov, Mihai Surdeanu

Second, we investigate the effect of socioeconomic factors (income, poverty, and education) on predicting state-level T2DM rates.

Assessment of central serous chorioretinopathy (CSC) depicted on color fundus photographs using deep Learning

no code implementations14 Jan 2019 Yi Zhen, Hang Chen, Xu Zhang, Meng Liu, Xin Meng, Jian Zhang, Jiantao Pu

To investigate whether and to what extent central serous chorioretinopathy (CSC) depicted on color fundus photographs can be assessed using deep learning technology.

Cannot find the paper you are looking for? You can Submit a new open access paper.