Search Results for author:
Found 25 papers, 15 papers with code
EXP-Bench: Can AI Conduct AI Research Experiments?
To enable the creation of such intricate and authentic tasks with high-fidelity, we design a semi-autonomous pipeline to extract and structure crucial experimental details from these research papers and their associated open-source code.
The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization
As the adoption of Generative AI in real-world services grow explosively, energy has emerged as a critical bottleneck resource.
Evaluation Framework for AI Systems in "the Wild"
Generative AI (GenAI) models have become vital across industries, yet current evaluation methods have not adapted to their widespread use.
Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents
Scientific experimentation, a cornerstone of human progress, demands rigor in reliability, methodical control, and interpretability to yield meaningful results.
Andes: Defining and Enhancing Quality-of-Experience in LLM-Based Text Streaming Services
Large language models (LLMs) are now at the core of conversational AI services such as real-time translation and chatbots, which provide live user interaction by incrementally streaming text to the user.
FedTrans: Efficient Federated Learning via Multi-Model Transformation
Federated learning (FL) aims to train machine learning (ML) models across potentially millions of edge client devices.
Toward Cross-Layer Energy Optimizations in AI Systems
The "AI for Science, Energy, and Security" report from DOE outlines a significant focus on developing and optimizing artificial intelligence workflows for a foundational impact on a broad range of DOE missions.
Venn: Resource Management for Collaborative Learning Jobs
In this paper, we present Venn, a CL resource manager that efficiently schedules ephemeral, heterogeneous devices among multiple CL jobs to reduce the average job completion time (JCT).
Reducing Energy Bloat in Large Model Training
Training large AI models on numerous GPUs consumes a massive amount of energy, making power delivery one of the largest limiting factors in building and operating datacenters for AI workloads.
Efficient Large Language Models: A Survey
We hope our survey can serve as a valuable resource to help researchers and practitioners gain a systematic understanding of efficient LLMs research and inspire them to contribute to this important and exciting field.
Oobleck: Resilient Distributed Training of Large Models Using Pipeline Templates
Oobleck enables resilient distributed training of large DNN models with guaranteed fault tolerance.
Chasing Low-Carbon Electricity for Practical and Sustainable DNN Training
Specifically, our solution observes real-time carbon intensity shifts during training and controls the energy consumption of GPUs, thereby reducing carbon footprint while maintaining training performance.
FLINT: A Platform for Federated Learning Integration
Cross-device federated learning (FL) has been well-studied from algorithmic, system scalability, and training speed perspectives.
DPack: Efficiency-Oriented Privacy Budget Scheduling
This DP budget can be regarded as a new type of compute resource in workloads of multiple ML models training on user data.
Auxo: Efficient Federated Learning via Scalable Client Clustering
In this paper, we explore an additional layer of complexity to mitigate such heterogeneity by grouping clients with statistically similar data distributions (cohorts).
Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training
In this paper, we observe that common practices to improve training performance can often lead to inefficient energy usage.
Swan: A Neural Engine for Efficient DNN Training on Smartphone SoCs
The need to train DNN models on end-user devices (e. g., smartphones) is increasing with the need to improve data privacy and reduce communication overheads.
Egeria: Efficient DNN Training with Knowledge-Guided Layer Freezing
To explore this, we first introduce the notion of training plasticity to quantify the training progress of internal DNN layers.
Treehouse: A Case For Carbon-Aware Datacenter Software
The end of Dennard scaling and the slowing of Moore's Law has put the energy use of datacenters on an unsustainable path.
The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning
The Internet of Things (IoT) is on the verge of a major paradigm shift.
Fed-ensemble: Improving Generalization through Model Ensembling in Federated Learning
In this paper we propose Fed-ensemble: a simple approach that bringsmodel ensembling to federated learning (FL).
FedScale: Benchmarking Model and System Performance of Federated Learning at Scale
We present FedScale, a federated learning (FL) benchmarking suite with realistic datasets and a scalable runtime to enable reproducible FL research.
Oort: Efficient Federated Learning via Guided Participant Selection
In this paper, we propose Oort to improve the performance of federated training and testing with guided participant selection.
Salus: Fine-Grained GPU Sharing Primitives for Deep Learning Applications
We show that these primitives can then be used to implement flexible sharing policies such as fairness, prioritization, and packing for various use cases.
Fast and Accurate Performance Analysis of LTE Radio Access Networks
Our choice of this domain is influenced by its commonalities with several other domains that produce real-time data, our access to a large live dataset, and their real-time nature and dimensionality which makes it a natural fit for a popular analysis technique, machine learning (ML).
