1 code implementation • 1 Oct 2024 • Zonghang Li, Wenjiao Feng, Mohsen Guizani, Hongfang Yu
In this paper, we argue that tensor parallelism can be more effective than pipeline on low-resource devices, and present a compute- and memory-efficient tensor parallel inference system, named TPI-LLM, to serve 70B-scale models.
no code implementations • 25 Oct 2023 • Zheshun Wu, Zenglin Xu, Hongfang Yu, Jie Liu
In FEEL, both mobile devices transmitting model parameters over noisy channels and collecting data in diverse environments pose challenges to the generalization of trained models.
1 code implementation • 7 Nov 2022 • Shenglai Zeng, Zonghang Li, Hongfang Yu, Zhihao Zhang, Long Luo, Bo Li, Dusit Niyato
Federated Learning (FL), as a rapidly evolving privacy-preserving collaborative machine learning paradigm, is a promising approach to enable edge intelligence in the emerging Industrial Metaverse.
no code implementations • 18 Feb 2022 • Xingjian Cao, Gang Sun, Hongfang Yu, Mohsen Guizani
Due to the differences of clients, a single global model may not perform well on all clients, so the personalized federated learning method, which trains a personalized model for each client that better suits its individual needs, becomes a research hotspot.
1 code implementation • 17 Feb 2022 • Xingjian Cao, Zonghang Li, Gang Sun, Hongfang Yu, Mohsen Guizani
CoFED is a federated learning method that is compatible with heterogeneous models, tasks, and training processes.
1 code implementation • 3 Feb 2022 • Zonghang Li, Yihong He, Hongfang Yu, Jiawen Kang, Xiaoping Li, Zenglin Xu, Dusit Niyato
In this paper, we propose FedGS, which is a hierarchical cloud-edge-end FL framework for 5G empowered industries, to improve industrial FL performance on non-i. i. d.
no code implementations • 31 Jan 2022 • Shenglai Zeng, Zonghang Li, Hongfang Yu, Yihong He, Zenglin Xu, Dusit Niyato, Han Yu
In this paper, we propose a data heterogeneity-robust FL approach, FedGSP, to address this challenge by leveraging on a novel concept of dynamic Sequential-to-Parallel (STP) collaborative training.
no code implementations • 20 Mar 2021 • Ke Zhang, Hanbo Ying, Hong-Ning Dai, Lin Li, Yuangyuang Peng, Keyi Guo, Hongfang Yu
Deep Neural Networks (DNNs) have shown great success in completing complex tasks.
no code implementations • 6 Apr 2018 • Xi Chen, Zonghang Li, Yupeng Zhang, Ruiming Long, Hongfang Yu, Xiaojiang Du, Mohsen Guizani
With the ever growing diversity of devices and applications that will be connected to 5G networks, flexible and agile service orchestration with acknowledged QoE that satisfies end-user's functional and QoS requirements is necessary.