Search Results for author: Sangeetha Abdu Jyothi

Found 5 papers, 1 papers with code

LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices

no code implementations1 Dec 2023 Junchen Zhao, Yurun Song, Simeng Liu, Ian G. Harris, Sangeetha Abdu Jyothi

Second, an optimized data transmission mechanism ensures efficient and structured data flow between model segments while also maintaining the integrity of the original model structure.

Language Modelling Large Language Model

CrystalBox: Future-Based Explanations for Input-Driven Deep RL Systems

no code implementations27 Feb 2023 Sagar Patel, Sangeetha Abdu Jyothi, Nina Narodytska

We present CrystalBox, a novel, model-agnostic, posthoc explainability framework for Deep Reinforcement Learning (DRL) controllers in the large family of input-driven environments which includes computer systems.

Continuous Control Decision Making

Caramel: Accelerating Decentralized Distributed Deep Learning with Computation Scheduling

no code implementations29 Apr 2020 Sayed Hadi Hashemi, Sangeetha Abdu Jyothi, Brighten Godfrey, Roy Campbell

The method of choice for parameter aggregation in Deep Neural Network (DNN) training, a network-intensive task, is shifting from the Parameter Server model to decentralized aggregation schemes (AllReduce) inspired by theoretical guarantees of better performance.

Scheduling

TicTac: Accelerating Distributed Deep Learning with Communication Scheduling

1 code implementation8 Mar 2018 Sayed Hadi Hashemi, Sangeetha Abdu Jyothi, Roy H. Campbell

We develop a system, TicTac, to improve the iteration time by fixing this issue in distributed deep learning with Parameter Servers while guaranteeing near-optimal overlap of communication and computation.

Scheduling

Cannot find the paper you are looking for? You can Submit a new open access paper.