Search Results for author: Zhijin Qin

Found 41 papers, 5 papers with code

A Robust Semantic Communication System for Image

no code implementations14 Mar 2024 Xiang Peng, Zhijin Qin, Xiaoming Tao, Jianhua Lu, Khaled B. Letaief

Semantic communications have gained significant attention as a promising approach to address the transmission bottleneck, especially with the continuous development of 6G techniques.

Robust Semantic Communications for Speech-to-Text Translation

1 code implementation8 Mar 2024 Zhenzi Weng, Zhijin Qin, Xiaoming Tao

Moreover, to cope with the practical communication scenario when the input speech is corrupted, a novel generative adversarial network (GAN)-enabled deep semantic compensator is proposed to predict the lost semantic information in the source speech and produce the textual semantic features in the target language simultaneously, which establishes a robust semantic transmission mechanism for dynamic speech input.

Generative Adversarial Network Speech-to-Text Translation +1

Computational Offloading in Semantic-Aware Cloud-Edge-End Collaborative Networks

no code implementations28 Feb 2024 Zelin Ji, Zhijin Qin

To minimize long-term energy consumption on constraints queue stability and computational delay, a Lyapunov-guided deep reinforcement learning hybrid (DRLH) framework is proposed to solve the mixed integer non-linear programming (MINLP) problem.

Cloud Computing Distributed Computing +2

Towards Intelligent Communications: Large Model Empowered Semantic Communications

no code implementations20 Feb 2024 Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Zhu Han

First, we propose a new semantic communication architecture that seamlessly integrates large models into semantic communication through the introduction of a memory module.

Federated Multi-View Synthesizing for Metaverse

no code implementations18 Dec 2023 Yiyu Guo, Zhijin Qin, Xiaoming Tao, Geoffrey Ye Li

With recent advances in edge intelligence and deep learning, we have developed a novel multi-view synthesizing framework that can efficiently provide computation, storage, and communication resources for wireless content delivery in the metaverse.

Domain Adaptation Federated Learning +1

Adaptive Resource Allocation for Semantic Communication Networks

no code implementations2 Dec 2023 Lingyi Wang, Wei Wu, Fuhui Zhou, Zhaohui Yang, Zhijin Qin

In order to investigate the performance of semantic communication networks, the quality of service for semantic communication (SC-QoS), including the semantic quantization efficiency (SQE) and transmission latency, is proposed for the first time.

Quantization

Compression Ratio Learning and Semantic Communications for Video Imaging

no code implementations10 Oct 2023 BoWen Zhang, Zhijin Qin, Geoffrey Ye Li

In this article, we also investigate the data transmission methods for programmable sensors, where the performance of communication systems is evaluated by the reconstructed images or videos rather than the transmission of sensor data itself.

Compressive Sensing Video Compressive Sensing

Meta Federated Reinforcement Learning for Distributed Resource Allocation

no code implementations6 Jul 2023 Zelin Ji, Zhijin Qin, Xiaoming Tao

In cellular networks, resource allocation is usually performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead.

Federated Learning Meta-Learning +1

Semantic-Aware Image Compressed Sensing

no code implementations6 Jul 2023 BoWen Zhang, Zhijin Qin, Geoffrey Ye Li

According to the base CS results, the encoder then employs a policy network to analyze the semantic information in images and determines the measurement matrix for different image areas.

Image Compressed Sensing

Semantic Communication with Memory

no code implementations22 Mar 2023 Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li

While semantic communication succeeds in efficiently transmitting due to the strong capability to extract the essential semantic information, it is still far from the intelligent or human-like communications.

Semantic Communications with Variable-Length Coding for Extended Reality

no code implementations17 Feb 2023 BoWen Zhang, Zhijin Qin, Geoffrey Ye Li

Wireless extended reality (XR) has attracted wide attentions as a promising technology to improve users' mobility and quality of experience.

Resource Optimization for Semantic-Aware Networks with Task Offloading

no code implementations20 Jan 2023 Zelin Ji, Zhijin Qin, Xiaoming Tao, Han Zhu

Edge computing, especially the edge intelligence system, enables local users to offload the computation tasks to the edge servers to reduce the computational energy consumption of user equipment and accelerate fast task execution.

Edge-computing Management +2

A Generalized Semantic Communication System: from Sources to Channels

no code implementations11 Jan 2023 Zhijin Qin, Feifei Gao, Bo Lin, Xiaoming Tao, Guangyi Liu, Chengkang Pan

This article introduces a framework for generalized semantic communication system, which exploits the semantic information in both the multimodal source and the wireless channel environment.

Semantic Sensing and Communications for Ultimate Extended Reality

no code implementations16 Dec 2022 BoWen Zhang, Zhijin Qin, Yiyu Guo, Geoffrey Ye Li

In particular, semantic sensing is used to improve the sensing efficiency by exploring the spatial-temporal distributions of semantic information.

Semantic Communication for Internet of Vehicles: A Multi-User Cooperative Approach

no code implementations6 Dec 2022 Wenjun Xu, Yimeng Zhang, Fengyu Wang, Zhijin Qin, Chenyao Liu, Ping Zhang

Internet of Vehicles (IoV) is expected to become the central infrastructure to provide advanced services to connected vehicles and users for higher transportation efficiency and security.

Image Retrieval Retrieval

Vector Quantized Semantic Communication System

no code implementations23 Sep 2022 Qifan Fu, Huiqiang Xie, Zhijin Qin, Gregory Slabaugh, Xiaoming Tao

Although analog semantic communication systems have received considerable attention in the literature, there is less work on digital semantic communication systems.

MS-SSIM Quantization +1

Robust Semantic Communications with Masked VQ-VAE Enabled Codebook

1 code implementation8 Jun 2022 Qiyu Hu, Guangyi Zhang, Zhijin Qin, Yunlong Cai, Guanding Yu, Geoffrey Ye Li

Although semantic communications have exhibited satisfactory performance for a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated.

Feature Importance

A Robust Deep Learning Enabled Semantic Communication System for Text

no code implementations6 Jun 2022 Xiang Peng, Zhijin Qin, Danlan Huang, Xiaoming Tao, Jianhua Lu, Guangyi Liu, Chengkang Pan

With the advent of the 6G era, the concept of semantic communication has attracted increasing attention.

A Unified Multi-Task Semantic Communication System with Domain Adaptation

no code implementations1 Jun 2022 Guangyi Zhang, Qiyu Hu, Zhijin Qin, Yunlong Cai, Guanding Yu

Simulation results demonstrate that our proposed U-DeepSC achieves comparable performance to the task-oriented semantic communication system designed for a specific task with significant transmission overhead reduction and much less number of model parameters.

Domain Adaptation

QoE-Aware Resource Allocation for Semantic Communication Networks

no code implementations28 May 2022 Lei Yan, Zhijin Qin, Rui Zhang, Yongzhao Li, Geoffrey Ye Li

Specifically, an approximate measure of semantic entropy is first developed to quantify the semantic information for different tasks, based on which a novel quality-of-experience (QoE) model is proposed.

Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesis

1 code implementation9 May 2022 Zhenzi Weng, Zhijin Qin, Xiaoming Tao, Chengkang Pan, Guangyi Liu, Geoffrey Ye Li

In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication system, respectively.

speech-recognition Speech Recognition +1

Federated Learning for Distributed Energy-Efficient Resource Allocation

no code implementations20 Apr 2022 Zelin Ji, Zhijin Qin

Analysis and numerical results show that the proposed FRL_suc framework can lower the transmission overhead and offload the computation from the central server to the local users, while outperforming the conventional multi-agent reinforcement learning algorithm in terms of EE, and is more robust to channel variations.

Federated Learning Multi-agent Reinforcement Learning +2

Robust Semantic Communications Against Semantic Noise

no code implementations7 Feb 2022 Qiyu Hu, Guangyi Zhang, Zhijin Qin, Yunlong Cai, Guanding Yu, Geoffrey Ye Li

In this paper, we first propose a framework for the robust end-to-end semantic communication systems to combat the semantic noise.

Quantization

Resource allocation for text semantic communications

1 code implementation16 Jan 2022 Lei Yan, Zhijin Qin, Rui Zhang, Yongzhao Li, Geoffrey Ye Li

Semantic communications have shown its great potential to improve the transmission reliability, especially in the low signal-to-noise regime.

Semantic Communications: Principles and Challenges

no code implementations30 Dec 2021 Zhijin Qin, Xiaoming Tao, Jianhua Lu, Wen Tong, Geoffrey Ye Li

Semantic communication, regarded as the breakthrough beyond the Shannon paradigm, aims at the successful transmission of semantic information conveyed by the source rather than the accurate reception of each single symbol or bit regardless of its meaning.

Task-Oriented Image Transmission for Scene Classification in Unmanned Aerial Systems

no code implementations21 Dec 2021 Xu Kang, Bin Song, Jie Guo, Zhijin Qin, F. Richard Yu

The vigorous developments of Internet of Things make it possible to extend its computing and storage capabilities to computing tasks in the aerial system with collaboration of cloud and edge, especially for artificial intelligence (AI) tasks based on deep learning (DL).

Classification Edge-computing +1

Task-Oriented Multi-User Semantic Communications

no code implementations19 Dec 2021 Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Khaled B. Letaief

For the single-modal multi-user system, we will propose two Transformer based models, named, DeepSC-IR and DeepSC-MT, to perform image retrieval and machine translation, respectively.

Image Retrieval Machine Translation +4

Task-Oriented Multi-User Semantic Communications for VQA Task

no code implementations16 Aug 2021 Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li

In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission.

Question Answering Visual Question Answering

Semantic Communications for Speech Recognition

no code implementations22 Jul 2021 Zhenzi Weng, Zhijin Qin, Geoffrey Ye Li

The traditional communications transmit all the source date represented by bits, regardless of the content of source and the semantic information required by the receiver.

speech-recognition Speech Recognition

Reconfigurable Intelligent Surface Assisted Device-to-Device Communications

no code implementations5 Jul 2021 Zelin Ji, Zhijin Qin, Clive G. Parini

Reconfigurable intelligent surface (RIS) technology is a promising method to enhance wireless communications services and to realize the smart radio environment.

Position

Software-Defined Edge Computing: A New Architecture Paradigm to Support IoT Data Analysis

no code implementations22 Apr 2021 Di wu, XiaoFeng Xie, Xiang Ni, Bin Fu, Hanhui Deng, Haibo Zeng, Zhijin Qin

We further present an experiment on data anomaly detection in this architecture, and the comparison between two architectures for ECG diagnosis.

Anomaly Detection Edge-computing

Semantic Communication Systems for Speech Transmission

no code implementations24 Feb 2021 Zhenzi Weng, Zhijin Qin

In order to improve the recovery accuracy of speech signals, especially for the essential information, DeepSC-S is developed based on an attention mechanism by utilizing a squeeze-and-excitation (SE) network.

Joint User Activity and Data Detection in Grant-Free NOMA using Generative Neural Networks

no code implementations7 Jan 2021 Yixuan Zou, Zhijin Qin, Yuanwei Liu

Grant-free non-orthogonal multiple access (NOMA) is considered as one of the supporting technology for massive connectivity for future networks.

Action Detection Activity Detection

Semantic Communications for Speech Signals

no code implementations9 Dec 2020 Zhenzi Weng, Zhijin Qin, Geoffrey Ye Li

We consider a semantic communication system for speech signals, named DeepSC-S.

A Lite Distributed Semantic Communication System for Internet of Things

no code implementations21 Jul 2020 Huiqiang Xie, Zhijin Qin

To make it affordable for IoT devices, we propose a lite distributed semantic communication system based on DL, named L-DeepSC, for text transmission with low complexity, where the data transmission from the IoT devices to the cloud/edge works at the semantic level to improve transmission efficiency.

Reconfigurable Intelligent Surface Enhanced Device-to-Device Communications

no code implementations22 Jun 2020 Zelin Ji, Zhijin Qin

Reconfigurable intelligent surface (RIS) technology is a promising method to enhance the device-to-device (D2D) communications.

Position

Deep Learning Enabled Semantic Communication Systems

no code implementations18 Jun 2020 Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li, Biing-Hwang Juang

To justify the performance of semantic communications accurately, we also initialize a new metric, named sentence similarity.

Sentence Sentence Similarity +1

Federated Learning and Wireless Communications

no code implementations11 May 2020 Zhijin Qin, Geoffrey Ye Li, Hao Ye

In contrast to other machine learning tools that require no communication resources, federated learning exploits communications between the central server and the distributed local clients to train and optimize a machine learning model.

Information Theory Signal Processing Information Theory

Cannot find the paper you are looking for? You can Submit a new open access paper.