Search Results for author: Neha Kunjal

Found 1 papers, 0 papers with code

ALTO: An Efficient Network Orchestrator for Compound AI Systems

no code implementations • 7 Mar 2024 • Keshav Santhanam, Deepti Raghavan, Muhammad Shahir Rahman, Thejas Venkatesh, Neha Kunjal, Pratiksha Thaker, Philip Levis, Matei Zaharia

We present ALTO, a network orchestrator for efficiently serving compound AI systems such as pipelines of language models.

Chatbot Scheduling

Paper
Add Code

Cannot find the paper you are looking for? You can Submit a new open access paper.