PRETZEL: Opening the Black Box of Machine Learning Prediction Serving Systems

14 Oct 2018Yunseong LeeAlberto ScolariByung-Gon ChunMarco Domenico SantambrogioMarkus WeimerMatteo Interlandi

Machine Learning models are often composed of pipelines of transformations. While this design allows to efficiently execute single model components at training time, prediction serving has different requirements such as low latency, high throughput and graceful performance degradation under heavy load... (read more)

PDF Abstract


No code implementations yet. Submit your code now


Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.