no code implementations • 14 Mar 2024 • Xiang Peng, Zhijin Qin, Xiaoming Tao, Jianhua Lu, Khaled B. Letaief
Semantic communications have gained significant attention as a promising approach to address the transmission bottleneck, especially with the continuous development of 6G techniques.
1 code implementation • 8 Mar 2024 • Zhenzi Weng, Zhijin Qin, Xiaoming Tao
Moreover, to cope with the practical communication scenario when the input speech is corrupted, a novel generative adversarial network (GAN)-enabled deep semantic compensator is proposed to predict the lost semantic information in the source speech and produce the textual semantic features in the target language simultaneously, which establishes a robust semantic transmission mechanism for dynamic speech input.
Generative Adversarial Network Speech-to-Text Translation +1
no code implementations • 20 Feb 2024 • Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Zhu Han
First, we propose a new semantic communication architecture that seamlessly integrates large models into semantic communication through the introduction of a memory module.
no code implementations • 18 Dec 2023 • Yiyu Guo, Zhijin Qin, Xiaoming Tao, Geoffrey Ye Li
With recent advances in edge intelligence and deep learning, we have developed a novel multi-view synthesizing framework that can efficiently provide computation, storage, and communication resources for wireless content delivery in the metaverse.
no code implementations • 8 Nov 2023 • Dingxi Yang, Zhijin Qin, Liting Wang, Xiaoming Tao, Fang Cui, Hengjiang Wang
The enormous data volume of video poses a significant burden on the network.
no code implementations • 6 Jul 2023 • Zelin Ji, Zhijin Qin, Xiaoming Tao
In cellular networks, resource allocation is usually performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead.
no code implementations • 31 Mar 2023 • Fan Deng, Xiaoming Tao, Pengxiang Wei, Shiyin Wei
Data-driven method for Structural Health Monitoring (SHM), that mine the hidden structural performance from the correlations among monitored time series data, has received widely concerns recently.
no code implementations • 20 Jan 2023 • Zelin Ji, Zhijin Qin, Xiaoming Tao, Han Zhu
Edge computing, especially the edge intelligence system, enables local users to offload the computation tasks to the edge servers to reduce the computational energy consumption of user equipment and accelerate fast task execution.
no code implementations • 14 Jan 2023 • Yuwen Yang, Feifei Gao, Xiaoming Tao, Guangyi Liu, Chengkang Pan
In this paper, we propose an environment semantics aided wireless communication framework to reduce the transmission latency and improve the transmission reliability, where semantic information is extracted from environment image data, selectively encoded based on its task-relevance, and then fused to make decisions for channel related tasks.
no code implementations • 11 Jan 2023 • Zhijin Qin, Feifei Gao, Bo Lin, Xiaoming Tao, Guangyi Liu, Chengkang Pan
This article introduces a framework for generalized semantic communication system, which exploits the semantic information in both the multimodal source and the wireless channel environment.
no code implementations • 23 Sep 2022 • Qifan Fu, Huiqiang Xie, Zhijin Qin, Gregory Slabaugh, Xiaoming Tao
Although analog semantic communication systems have received considerable attention in the literature, there is less work on digital semantic communication systems.
1 code implementation • 16 Sep 2022 • Guangyi Zhang, Qiyu Hu, Zhijin Qin, Yunlong Cai, Guanding Yu, Xiaoming Tao
Task-oriented semantic communications have achieved significant performance gains.
no code implementations • 8 Aug 2022 • Danlan Huang, Feifei Gao, Xiaoming Tao, Qiyuan Du, Jianhua Lu
Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information.
no code implementations • 23 Jul 2022 • Weihua Xu, Feifei Gao, Xiaoming Tao, Jianhua Zhang, Ahmed Alkhateeb
Visual information, captured for example by cameras, can effectively reflect the sizes and locations of the environmental scattering objects, and thereby can be used to infer communications parameters like propagation directions, receiver powers, as well as the blockage status.
no code implementations • 6 Jun 2022 • Xiang Peng, Zhijin Qin, Danlan Huang, Xiaoming Tao, Jianhua Lu, Guangyi Liu, Chengkang Pan
With the advent of the 6G era, the concept of semantic communication has attracted increasing attention.
1 code implementation • 9 May 2022 • Zhenzi Weng, Zhijin Qin, Xiaoming Tao, Chengkang Pan, Guangyi Liu, Geoffrey Ye Li
In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication system, respectively.
no code implementations • 30 Dec 2021 • Zhijin Qin, Xiaoming Tao, Jianhua Lu, Wen Tong, Geoffrey Ye Li
Semantic communication, regarded as the breakthrough beyond the Shannon paradigm, aims at the successful transmission of semantic information conveyed by the source rather than the accurate reception of each single symbol or bit regardless of its meaning.
no code implementations • 19 Dec 2021 • Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Khaled B. Letaief
For the single-modal multi-user system, we will propose two Transformer based models, named, DeepSC-IR and DeepSC-MT, to perform image retrieval and machine translation, respectively.
no code implementations • 4 Mar 2021 • Chaoyi Han, Yiping Duan, Xiaoming Tao, Jianhua Lu
We show that our model performs well in measuring the similarity between restored and degraded images.
no code implementations • 1 Mar 2021 • Chengxiao Liu, Wei Feng, Xiaoming Tao, Ning Ge
Nevertheless, communication and MEC systems are coupled with each other under the influence of complex propagation environment in the MEC-empowered NTN, which makes it hard to orchestrate the resources.
no code implementations • 19 Jan 2021 • Weihua Xu, Feifei Gao, Jianhua Zhang, Xiaoming Tao, Ahmed Alkhateeb
Channel covariance matrix (CCM) is one critical parameter for designing the communications systems.
no code implementations • 15 Apr 2019 • Mai Xu, Li Yang, Xiaoming Tao, Yiping Duan, Zulin Wang
According to these findings, our SalGAIL approach applies deep reinforcement learning (DRL) to predict the head fixations of one subject, in which GAIL learns the reward of DRL, rather than the traditional human-designed reward.
no code implementations • 5 Mar 2019 • Tianyi Li, Mai Xu, Ren Yang, Xiaoming Tao
High efficiency video coding (HEVC) has brought outperforming efficiency for video compression.