Search Results for author: Xiaoming Tao

Found 23 papers, 3 papers with code

A Robust Semantic Communication System for Image

no code implementations14 Mar 2024 Xiang Peng, Zhijin Qin, Xiaoming Tao, Jianhua Lu, Khaled B. Letaief

Semantic communications have gained significant attention as a promising approach to address the transmission bottleneck, especially with the continuous development of 6G techniques.

Robust Semantic Communications for Speech-to-Text Translation

1 code implementation8 Mar 2024 Zhenzi Weng, Zhijin Qin, Xiaoming Tao

Moreover, to cope with the practical communication scenario when the input speech is corrupted, a novel generative adversarial network (GAN)-enabled deep semantic compensator is proposed to predict the lost semantic information in the source speech and produce the textual semantic features in the target language simultaneously, which establishes a robust semantic transmission mechanism for dynamic speech input.

Generative Adversarial Network Speech-to-Text Translation +1

Towards Intelligent Communications: Large Model Empowered Semantic Communications

no code implementations20 Feb 2024 Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Zhu Han

First, we propose a new semantic communication architecture that seamlessly integrates large models into semantic communication through the introduction of a memory module.

Federated Multi-View Synthesizing for Metaverse

no code implementations18 Dec 2023 Yiyu Guo, Zhijin Qin, Xiaoming Tao, Geoffrey Ye Li

With recent advances in edge intelligence and deep learning, we have developed a novel multi-view synthesizing framework that can efficiently provide computation, storage, and communication resources for wireless content delivery in the metaverse.

Domain Adaptation Federated Learning +1

Meta Federated Reinforcement Learning for Distributed Resource Allocation

no code implementations6 Jul 2023 Zelin Ji, Zhijin Qin, Xiaoming Tao

In cellular networks, resource allocation is usually performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead.

Federated Learning Meta-Learning +1

A robust deep learning-based damage identification approach for SHM considering missing data

no code implementations31 Mar 2023 Fan Deng, Xiaoming Tao, Pengxiang Wei, Shiyin Wei

Data-driven method for Structural Health Monitoring (SHM), that mine the hidden structural performance from the correlations among monitored time series data, has received widely concerns recently.

Imputation Time Series

Resource Optimization for Semantic-Aware Networks with Task Offloading

no code implementations20 Jan 2023 Zelin Ji, Zhijin Qin, Xiaoming Tao, Han Zhu

Edge computing, especially the edge intelligence system, enables local users to offload the computation tasks to the edge servers to reduce the computational energy consumption of user equipment and accelerate fast task execution.

Edge-computing Management +2

Environment Semantics Aided Wireless Communications: A Case Study of mmWave Beam Prediction and Blockage Prediction

no code implementations14 Jan 2023 Yuwen Yang, Feifei Gao, Xiaoming Tao, Guangyi Liu, Chengkang Pan

In this paper, we propose an environment semantics aided wireless communication framework to reduce the transmission latency and improve the transmission reliability, where semantic information is extracted from environment image data, selectively encoded based on its task-relevance, and then fused to make decisions for channel related tasks.

feature selection

A Generalized Semantic Communication System: from Sources to Channels

no code implementations11 Jan 2023 Zhijin Qin, Feifei Gao, Bo Lin, Xiaoming Tao, Guangyi Liu, Chengkang Pan

This article introduces a framework for generalized semantic communication system, which exploits the semantic information in both the multimodal source and the wireless channel environment.

Vector Quantized Semantic Communication System

no code implementations23 Sep 2022 Qifan Fu, Huiqiang Xie, Zhijin Qin, Gregory Slabaugh, Xiaoming Tao

Although analog semantic communication systems have received considerable attention in the literature, there is less work on digital semantic communication systems.

MS-SSIM Quantization +1

Towards Semantic Communications: Deep Learning-Based Image Semantic Coding

no code implementations8 Aug 2022 Danlan Huang, Feifei Gao, Xiaoming Tao, Qiyuan Du, Jianhua Lu

Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information.

Image Reconstruction Quantization +2

Computer Vision Aided mmWave Beam Alignment in V2X Communications

no code implementations23 Jul 2022 Weihua Xu, Feifei Gao, Xiaoming Tao, Jianhua Zhang, Ahmed Alkhateeb

Visual information, captured for example by cameras, can effectively reflect the sizes and locations of the environmental scattering objects, and thereby can be used to infer communications parameters like propagation directions, receiver powers, as well as the blockage status.

3D Object Detection object-detection

A Robust Deep Learning Enabled Semantic Communication System for Text

no code implementations6 Jun 2022 Xiang Peng, Zhijin Qin, Danlan Huang, Xiaoming Tao, Jianhua Lu, Guangyi Liu, Chengkang Pan

With the advent of the 6G era, the concept of semantic communication has attracted increasing attention.

Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesis

1 code implementation9 May 2022 Zhenzi Weng, Zhijin Qin, Xiaoming Tao, Chengkang Pan, Guangyi Liu, Geoffrey Ye Li

In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication system, respectively.

speech-recognition Speech Recognition +1

Semantic Communications: Principles and Challenges

no code implementations30 Dec 2021 Zhijin Qin, Xiaoming Tao, Jianhua Lu, Wen Tong, Geoffrey Ye Li

Semantic communication, regarded as the breakthrough beyond the Shannon paradigm, aims at the successful transmission of semantic information conveyed by the source rather than the accurate reception of each single symbol or bit regardless of its meaning.

Task-Oriented Multi-User Semantic Communications

no code implementations19 Dec 2021 Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Khaled B. Letaief

For the single-modal multi-user system, we will propose two Transformer based models, named, DeepSC-IR and DeepSC-MT, to perform image retrieval and machine translation, respectively.

Image Retrieval Machine Translation +4

MEC-Empowered Non-Terrestrial Network for 6G Wide-Area Time-Sensitive Internet of Things

no code implementations1 Mar 2021 Chengxiao Liu, Wei Feng, Xiaoming Tao, Ning Ge

Nevertheless, communication and MEC systems are coupled with each other under the influence of complex propagation environment in the MEC-empowered NTN, which makes it hard to orchestrate the resources.

Edge-computing

Saliency Prediction on Omnidirectional Images with Generative Adversarial Imitation Learning

no code implementations15 Apr 2019 Mai Xu, Li Yang, Xiaoming Tao, Yiping Duan, Zulin Wang

According to these findings, our SalGAIL approach applies deep reinforcement learning (DRL) to predict the head fixations of one subject, in which GAIL learns the reward of DRL, rather than the traditional human-designed reward.

Imitation Learning Saliency Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.