1 code implementation • 8 Mar 2024 • Zhenzi Weng, Zhijin Qin, Xiaoming Tao
Moreover, to cope with the practical communication scenario when the input speech is corrupted, a novel generative adversarial network (GAN)-enabled deep semantic compensator is proposed to predict the lost semantic information in the source speech and produce the textual semantic features in the target language simultaneously, which establishes a robust semantic transmission mechanism for dynamic speech input.
Generative Adversarial Network Speech-to-Text Translation +1
1 code implementation • 9 May 2022 • Zhenzi Weng, Zhijin Qin, Xiaoming Tao, Chengkang Pan, Guangyi Liu, Geoffrey Ye Li
In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication system, respectively.
no code implementations • 22 Jul 2021 • Zhenzi Weng, Zhijin Qin, Geoffrey Ye Li
The traditional communications transmit all the source date represented by bits, regardless of the content of source and the semantic information required by the receiver.
no code implementations • 24 Feb 2021 • Zhenzi Weng, Zhijin Qin
In order to improve the recovery accuracy of speech signals, especially for the essential information, DeepSC-S is developed based on an attention mechanism by utilizing a squeeze-and-excitation (SE) network.
no code implementations • 9 Dec 2020 • Zhenzi Weng, Zhijin Qin, Geoffrey Ye Li
We consider a semantic communication system for speech signals, named DeepSC-S.