Search Results for author: Hailin Zhang

Found 28 papers, 9 papers with code

Concentric UCAs Based Low-Order OAM for High Capacity in Radio Vortex Wireless Communications

no code implementations13 Aug 2024 Haiyue Jing, Wenchi Cheng, Zan Li, Hailin Zhang

Numerical simulations are presented to validate and evaluate that our developed concentric UCAs based low-order RowComms can significantly increase the capacity as compared with that of singular UCA based RowComms.

Achieving Practical OAM Based Wireless Communications With Misaligned Transceiver

no code implementations13 Aug 2024 Wenchi Cheng, Haiyue Jing, Wei zhang, Zan Li, Hailin Zhang

To maintain the orthogonality among different OAM modes at the receiver, the strict alignment between transmit and receive antennas is highly demanded.

Orbital-Angular-Momentum Embedded Massive MIMO: Achieving Multiplicative Spectrum-Efficiency for mmWave Communications

no code implementations13 Aug 2024 Wenchi Cheng, Hailin Zhang, Liping Liang, Haiyue Jing, Zan Li

Traditional massive-MIMO based mmWave communications did not concern the potential spectrum-efficiency-gain (SE-gain) offered by orthogonal states of OAM.

Orbital-Angular-Momentum Versus MIMO: Orthogonality, Degree of Freedom,and Capacity

no code implementations13 Aug 2024 Haiyue Jing, Wenchi Cheng, Xiang-Gen Xia, Hailin Zhang

The plane wave based wireless communications have becoming more and more matured, along with the well utilization of the traditional resources such as time and frequency.

Quasi-Fractal UCA Based OAM for Highly Efficient Orthogonal Transmission

no code implementations10 Aug 2024 Wenchi Cheng, Haiyue Jing, Wei zhang, Keyi Zhang, Hailin Zhang

We perform the two-dimension OAM modulation (TOM) and demodulation (TOD) schemes with the orthogonal OAM mode number exceeding the array-element number, which is beyond the traditional concept of multiple antennas based wireless communications.

Multibeam Hybrid Transmitarray Based on Polarization Rotating Metasurface With Reconfigurable Bidirectional Radiation

no code implementations2 Aug 2024 Fan Qin, Yifei Liu, Chao Gu, Linfeng Zeng, Wenchi Cheng, Hailin Zhang, Steven Gao

To accomplish the reconfiguration of both unidirectional and bidirectional radiation states in the +z, -z, and +/-z directions, a polarization switchable multi-feed array (MFA) is placed at the focal plane between the TA and FTA, radiating x-polarization, y-polarization, and 45-degree oblique polarization waves, respectively.

Resource Allocation for 5G-UAV Based Emergency Wireless Communications

no code implementations24 Jul 2024 Zhuohui Yao, Wenchi Cheng, Wei zhang, Hailin Zhang

Numerical results show that the new heterogeneous Fisher-Snedecor $\mathcal{F}$ composite fading channel adapted resource allocation schemes can achieve higher capacity and energy efficiency than those of traditional channel model adapted resource allocation schemes, thus providing better communications service for post-disaster areas.

Virtual Full-Duplex Wireless Communications with Zero-Interval Modulation and Sampling

no code implementations24 Jul 2024 Jianyu Wang, Wenchi Cheng, Wei zhang, Hailin Zhang

In ZIMS-VFD, the transceiver inserts a zero-interval for each symbol in the transmit signal and provides self-interference (SI)-free intervals for itself.

Joint OAM Multiplexing and OFDM in Sparse Multipath Environments

no code implementations18 Jul 2024 Liping Liang, Wenchi Cheng, Wei zhang, Hailin Zhang

In this paper, a hybrid orthogonal division multiplexing (HODM) scheme by using OAM multiplexing and orthogonal frequency division multiplexing (OFDM) in conjunction is proposed to achieve high-capacity wireless communications in sparse multipath environments, where the scatterers are sparse.

Mode Hopping for Anti-Jamming in Radio Vortex Wireless Communications

no code implementations18 Jul 2024 Liping Liang, Wenchi Cheng, Wei zhang, Hailin Zhang

In particular, we propose the mode hopping (MH) scheme for antijamming within the narrow frequency band.

Mode Hopping with OAM-Based Index Modulation

no code implementations18 Jul 2024 Liping Liang, Wenchi Cheng, Wei zhang, Hailin Zhang

In this paper, we propose an MH with OAM-based index modulation scheme, where several OAM-modes are activated for hopping, to achieve high SE at a given bit error rate in radio vortex wireless communications.

Index Modulation Embedded Mode Hopping for Anti-Jamming

no code implementations17 Jul 2024 Liping Liang, Wenchi Cheng, Wei zhang, Hailin Zhang

To achieve efficient anti-jamming and increase SE of wireless communications with slight computational complexity cost, in this paper we propose an index-modulation embedded mode-hopping (IM-MH) scheme, which simultaneously activates several OAM-modes for hopping along with additional index information and signal information transmission.

Reconfigurable-Intelligent-Surface Assisted Orbital-Angular-Momentum Secure Communications

no code implementations16 Jul 2024 Minmin Wang, Liping Liang, Wenchi Cheng, Wei zhang, Ruirui Chen, Hailin Zhang

As a kind of wavefront with helical phase, orbital angular momentum (OAM) shows the great potential to enhance the security results of wireless communications due to its unique orthogonality and central hollow electromagnetic wave structure.

MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training

no code implementations16 Jul 2024 Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

By leveraging fine-grained activation memory management, MEMO facilitates efficient training of 7B LLM with 1 million sequence length on just 8 A800 GPUs, achieving an MFU of 52. 30%.

Management

OAM-SWIPT for IoE-Driven 6G

no code implementations8 Jun 2024 Runyu Lyu, Wenchi Cheng, Bazhong Shen, Zhiyuan Ren, Hailin Zhang

In this article, we introduce the OAM-based SWIPT as well as discuss some basic advantages and challenges for it.

Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling

no code implementations23 May 2024 Shuaipeng Li, Penghao Zhao, Hailin Zhang, Xingwu Sun, Hao Wu, Dian Jiao, Weiyan Wang, Chengjun Liu, Zheng Fang, Jinbao Xue, Yangyu Tao, Bin Cui, Di Wang

First, we raise the scaling law between batch sizes and optimal learning rates in the sign of gradient case, in which we prove that the optimal learning rate first rises and then falls as the batch size increases.

Retrieval-Augmented Generation for AI-Generated Content: A Survey

3 code implementations29 Feb 2024 Penghao Zhao, Hailin Zhang, Qinhan Yu, Zhengren Wang, Yunteng Geng, Fangcheng Fu, Ling Yang, Wentao Zhang, Jie Jiang, Bin Cui

We first classify RAG foundations according to how the retriever augments the generator, distilling the fundamental abstractions of the augmentation methodologies for various retrievers and generators.

Information Retrieval multimodal generation +3

CAFE: Towards Compact, Adaptive, and Fast Embedding for Large-scale Recommendation Models

1 code implementation6 Dec 2023 Hailin Zhang, Zirui Liu, Boxuan Chen, Yikai Zhao, Tong Zhao, Tong Yang, Bin Cui

Guided by our design philosophy, we further propose a multi-level hash embedding framework to optimize the embedding tables of non-hot features.

Feature Importance Philosophy

Experimental Analysis of Large-scale Learnable Vector Storage Compression

1 code implementation27 Nov 2023 Hailin Zhang, Penghao Zhao, Xupeng Miao, Yingxia Shao, Zirui Liu, Tong Yang, Bin Cui

Learnable embedding vector is one of the most important applications in machine learning, and is widely used in various database-related domains.

Benchmarking

Model-enhanced Vector Index

1 code implementation NeurIPS 2023 Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui

We empirically show that our model achieves better performance on the commonly used academic benchmarks MSMARCO Passage and Natural Questions, with comparable serving latency to dense retrieval solutions.

model Natural Questions +2

Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning

1 code implementation11 Jun 2023 Hailin Zhang, Defang Chen, Can Wang

Multi-Teacher knowledge distillation provides students with additional supervision from multiple pre-trained teachers with diverse information sources.

Knowledge Distillation Meta-Learning

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

2 code implementations25 Nov 2022 Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

Transformer models have achieved state-of-the-art performance on various domains of applications and gradually becomes the foundations of the advanced large deep learning (DL) models.

Knowledge Distillation with the Reused Teacher Classifier

1 code implementation CVPR 2022 Defang Chen, Jian-Ping Mei, Hailin Zhang, Can Wang, Yan Feng, Chun Chen

Knowledge distillation aims to compress a powerful yet cumbersome teacher model into a lightweight student model without much sacrifice of performance.

Knowledge Distillation

Confidence-Aware Multi-Teacher Knowledge Distillation

1 code implementation30 Dec 2021 Hailin Zhang, Defang Chen, Can Wang

Knowledge distillation is initially introduced to utilize additional supervision from a single teacher model for the student model training.

Knowledge Distillation Transfer Learning

Coexistence under hierarchical resource exploitation: the role of R*-preemption tradeoff

no code implementations22 Aug 2019 Man Qi, Niv DeMalach, Tao Sun, Hailin Zhang

Thus, we developed an extension of resource competition theory to investigate partial and total preemption (in the latter, the preemptor is unaffected by species with lower preemption rank).

Cannot find the paper you are looking for? You can Submit a new open access paper.