Search Results for author:
Found 11 papers, 3 papers with code
CrysFormer: Protein Structure Prediction via 3d Patterson Maps and Partial Structure Attention
Determining the structure of a protein has been a decades-long open question.
Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation
Large Language Models (LLMs) have the ability to solve a variety of tasks, such as text summarization and mathematical questions, just out of the box, but they are often trained with a single task in mind.
Fast FixMatch: Faster Semi-Supervised Learning with Curriculum Batch Size
Advances in Semi-Supervised Learning (SSL) have almost entirely closed the gap between SSL and Supervised Learning at a fraction of the number of labels.
FedJETs: Efficient Just-In-Time Personalization with Federated Mixture of Experts
Our gating function harnesses the knowledge of a pretrained model common expert to enhance its routing decisions on-the-fly.
LOFT: Finding Lottery Tickets through Filter-wise Training
\textsc{LoFT} is a model-parallel pretraining algorithm that partitions convolutional layers by filters to train them independently in a distributed setting, resulting in reduced memory and communication costs during pretraining.
Efficient and Light-Weight Federated Learning via Asynchronous Distributed Dropout
Asynchronous learning protocols have regained attention lately, especially in the Federated Learning (FL) setup, where slower clients can severely impede the learning process.
Federated Multiple Label Hashing (FedMLH): Communication Efficient Federated Learning on Extreme Classification Tasks
Federated learning enables many local devices to train a deep learning model jointly without sharing the local data.
ResIST: Layer-Wise Decomposition of ResNets for Distributed Training
Thus, ResIST reduces the per-iteration communication, memory, and time requirements of ResNet training to only a fraction of the requirements of full-model training.
GIST: Distributed Training for Large-Scale Graph Convolutional Networks
The graph convolutional network (GCN) is a go-to solution for machine learning on graphs, but its training is notoriously difficult to scale both in terms of graph size and the number of model parameters.
Distributed Learning of Deep Neural Networks using Independent Subnet Training
These properties of IST can cope with issues due to distributed data, slow interconnects, or limited device memory, making IST a suitable approach for cases of mandatory distribution.
Graph Convolutional Reinforcement Learning
The key is to understand the mutual interplay between agents.
