Online Learning for Orchestration of Inference in Multi-User End-Edge-Cloud Networks

no code implementations • 21 Feb 2022 • Sina Shahhosseini, Dongjoo Seo, Anil Kanduri, Tianyi Hu, Sung-soo Lim, Bryan Donyanavard, Amir M. Rahmani, Nikil Dutt

To this end, we propose a reinforcement-learning-based computation offloading solution that learns optimal offloading policy considering deep learning model selection techniques to minimize response time while providing sufficient accuracy.

Cloud Computing Decision Making +2

Hybrid Learning for Orchestrating Deep Learning Inference in Multi-user Edge-cloud Networks

no code implementations • 21 Feb 2022 • Sina Shahhosseini, Tianyi Hu, Dongjoo Seo, Anil Kanduri, Bryan Donyanavard, Amir M. Rahmani, Nikil Dutt

Furthermore, we deploy Hybrid Learning (HL) to accelerate the RL learning process and reduce the number of direct samplings.

Cloud Computing reinforcement-learning +1