no code implementations • 15 Jun 2022 • Rongkang Dong, Yuyi Mao, Jun Zhang
In this paper, we propose an early exit prediction mechanism to reduce the on-device computation overhead in a device-edge co-inference system supported by early-exit networks.