Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

no code implementations • 3 Jun 2024 • Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

This paper introduces Helix, a distributed system for high-throughput, low-latency large language model (LLM) serving on heterogeneous GPU clusters.

Language Modeling Language Modelling +2

Quarl: A Learning-Based Quantum Circuit Optimizer

no code implementations • 17 Jul 2023 • Zikun Li, Jinjun Peng, Yixuan Mei, Sina Lin, Yi Wu, Oded Padon, Zhihao Jia

Applying reinforcement learning (RL) to quantum circuit optimization raises two main challenges: the large and varying action space and the non-uniform state representation.

Reinforcement Learning (RL)