Search Results for author: Yoshiaki Inoue

Found 2 papers, 0 papers with code

Queueing Analysis of GPU-Based Inference Servers with Dynamic Batching: A Closed-Form Characterization

no code implementations13 Dec 2019 Yoshiaki Inoue

An important characteristic of GPU-based inference is that the computational efficiency, in terms of the processing speed and energy consumption, drastically increases by processing multiple jobs together in a batch.

Computational Efficiency

Cannot find the paper you are looking for? You can Submit a new open access paper.