Search Results for author: Enmao Diao

Found 18 papers, 13 papers with code

ColA: Collaborative Adaptation with Gradient Learning

1 code implementation22 Apr 2024 Enmao Diao, Qi Le, Suya Wu, Xinran Wang, Ali Anwar, Jie Ding, Vahid Tarokh

We introduce Collaborative Adaptation (ColA) with Gradient Learning (GL), a parameter-free, model-agnostic fine-tuning approach that decouples the computation of the gradient of hidden representations and parameters.

Large Deviation Analysis of Score-based Hypothesis Testing

no code implementations27 Jan 2024 Enmao Diao, Taposh Banerjee, Vahid Tarokh

We analyze the performance of this score-based hypothesis testing procedure and derive upper bounds on the probabilities of its Type I and II errors.

Semi-Supervised Federated Learning for Keyword Spotting

1 code implementation9 May 2023 Enmao Diao, Eric W. Tramel, Jie Ding, Tao Zhang

Keyword Spotting (KWS) is a critical aspect of audio-based applications on mobile devices and virtual assistants.

Federated Learning Keyword Spotting

Pruning Deep Neural Networks from a Sparsity Perspective

1 code implementation ICLR 2023 Enmao Diao, Ganghua Wang, Jiawei Zhan, Yuhong Yang, Jie Ding, Vahid Tarokh

Our extensive experiments corroborate the hypothesis that for a generic pruning procedure, PQI decreases first when a large model is being effectively regularized and then increases when its compressibility reaches a limit that appears to correspond to the beginning of underfitting.

Network Pruning

Quickest Change Detection for Unnormalized Statistical Models

no code implementations1 Feb 2023 Suya Wu, Enmao Diao, Taposh Banerjee, Jie Ding, Vahid Tarokh

This paper develops a new variant of the classical Cumulative Sum (CUSUM) algorithm for the quickest change detection.

Change Detection

A Physics-Informed Vector Quantized Autoencoder for Data Compression of Turbulent Flow

1 code implementation10 Jan 2022 Mohammadreza Momenifar, Enmao Diao, Vahid Tarokh, Andrew D. Bragg

In this study, we apply a physics-informed Deep Learning technique based on vector quantization to generate a discrete, low-dimensional representation of data from simulations of three-dimensional turbulent flows.

Data Compression Quantization

GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborations

1 code implementation2 Jun 2021 Enmao Diao, Jie Ding, Vahid Tarokh

However, the underlying organizations may have little interest in sharing their local data, models, and objective functions.

On Statistical Efficiency in Learning

1 code implementation24 Dec 2020 Jie Ding, Enmao Diao, Jiawei Zhou, Vahid Tarokh

We propose a generalized notion of Takeuchi's information criterion and prove that the proposed method can asymptotically achieve the optimal out-sample prediction loss under reasonable assumptions.

Model Selection

HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients

3 code implementations ICLR 2021 Enmao Diao, Jie Ding, Vahid Tarokh

In this work, we propose a new federated learning framework named HeteroFL to address heterogeneous clients equipped with very different computation and communication capabilities.

Federated Learning

Multimodal Controller for Generative Models

1 code implementation7 Feb 2020 Enmao Diao, Jie Ding, Vahid Tarokh

In the absence of the controllers, our model reduces to non-conditional generative models.

Deep Clustering of Compressed Variational Embeddings

no code implementations23 Oct 2019 Suya Wu, Enmao Diao, Jie Ding, Vahid Tarokh

Motivated by the ever-increasing demands for limited communication bandwidth and low-power consumption, we propose a new methodology, named joint Variational Autoencoders with Bernoulli mixture models (VAB), for performing clustering in the compressed data domain.

Clustering Deep Clustering

Speech Emotion Recognition with Dual-Sequence LSTM Architecture

no code implementations20 Oct 2019 Jianyou Wang, Michael Xue, Ryan Culhane, Enmao Diao, Jie Ding, Vahid Tarokh

Speech Emotion Recognition (SER) has emerged as a critical component of the next generation human-machine interfacing technologies.

Speech Emotion Recognition

Restricted Recurrent Neural Networks

1 code implementation21 Aug 2019 Enmao Diao, Jie Ding, Vahid Tarokh

Recurrent Neural Network (RNN) and its variations such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), have become standard building blocks for learning online data of sequential nature in many research areas, including natural language processing and speech data analysis.

Language Modelling

DRASIC: Distributed Recurrent Autoencoder for Scalable Image Compression

1 code implementation23 Mar 2019 Enmao Diao, Jie Ding, Vahid Tarokh

We propose a new architecture for distributed image compression from a group of distributed data sources.

Image Compression

Cannot find the paper you are looking for? You can Submit a new open access paper.