Search Results for author: Kai Yi

Found 21 papers, 13 papers with code

FedP3: Federated Personalized and Privacy-friendly Network Pruning under Model Heterogeneity

no code implementations15 Apr 2024 Kai Yi, Nidham Gazagnadou, Peter Richtárik, Lingjuan Lyu

The interest in federated learning has surged in recent research due to its unique ability to train a global model using privacy-secured information held locally on each client.

Federated Learning Network Pruning

DiffImpute: Tabular Data Imputation With Denoising Diffusion Probabilistic Model

1 code implementation20 Mar 2024 Yizhu Wen, Kai Yi, Jing Ke, Yiqing Shen

Specifically, DiffImpute is trained on complete tabular datasets, ensuring that it can produce credible imputations for missing entries without undermining the authenticity of the existing data.

Denoising Imputation

FedComLoc: Communication-Efficient Distributed Training of Sparse and Quantized Models

no code implementations14 Mar 2024 Kai Yi, Georg Meinhardt, Laurent Condat, Peter Richtárik

Federated Learning (FL) has garnered increasing attention due to its unique characteristic of allowing heterogeneous clients to process their private data locally and interact with a central server, while being respectful of privacy.

Federated Learning Quantization

Continual Zero-Shot Learning through Semantically Guided Generative Random Walks

1 code implementation ICCV 2023 Wenxuan Zhang, Paul Janson, Kai Yi, Ivan Skorokhodov, Mohamed Elhoseiny

The GRW loss augments the training by continually encouraging the model to generate realistic and characterized samples to represent the unseen space.

Novel Concepts Zero-Shot Learning

Graph Denoising Diffusion for Inverse Protein Folding

1 code implementation NeurIPS 2023 Kai Yi, Bingxin Zhou, Yiqing Shen, Pietro Liò, Yu Guang Wang

In contrast, diffusion probabilistic models, as an emerging genre of generative approaches, offer the potential to generate a diverse set of sequence candidates for determined protein backbones.

Denoising Protein Folding

Explicit Personalization and Local Training: Double Communication Acceleration in Federated Learning

1 code implementation22 May 2023 Kai Yi, Laurent Condat, Peter Richtárik

Federated Learning is an evolving machine learning paradigm, in which multiple clients perform computations based on their individual private data, interspersed by communication with a remote server.

Federated Learning

Accurate and Definite Mutational Effect Prediction with Lightweight Equivariant Graph Neural Networks

no code implementations13 Apr 2023 Bingxin Zhou, Outongyi Lv, Kai Yi, Xinye Xiong, Pan Tan, Liang Hong, Yu Guang Wang

Directed evolution as a widely-used engineering strategy faces obstacles in finding desired mutants from the massive size of candidate modifications.

Graph Representation Learning

Variance Reduced ProxSkip: Algorithm, Theory and Application to Federated Learning

1 code implementation9 Jul 2022 Grigory Malinovsky, Kai Yi, Peter Richtárik

We study distributed optimization methods based on the {\em local training (LT)} paradigm: achieving communication efficiency by performing richer local gradient-based training on the clients before parameter averaging.

Distributed Optimization Federated Learning

Approximate Equivariance SO(3) Needlet Convolution

no code implementations17 Jun 2022 Kai Yi, Jialin Chen, Yu Guang Wang, Bingxin Zhou, Pietro Liò, Yanan Fan, Jan Hamann

This paper develops a rotation-invariant needlet convolution for rotation group SO(3) to distill multiscale information of spherical signals.

Quantum Chemistry Regression

ACMP: Allen-Cahn Message Passing for Graph Neural Networks with Particle Phase Transition

1 code implementation11 Jun 2022 Yuelin Wang, Kai Yi, Xinliang Liu, Yu Guang Wang, Shi Jin

Neural message passing is a basic feature extraction unit for graph-structured data considering neighboring node features in network propagation from one layer to the next.

Node Classification

EF-BV: A Unified Theory of Error Feedback and Variance Reduction Mechanisms for Biased and Unbiased Compression in Distributed Optimization

1 code implementation9 May 2022 Laurent Condat, Kai Yi, Peter Richtárik

Our general approach works with a new, larger class of compressors, which has two parameters, the bias and the variance, and includes unbiased and biased compressors as particular cases.

Distributed Optimization

Exploring Hierarchical Graph Representation for Large-Scale Zero-Shot Image Classification

1 code implementation2 Mar 2022 Kai Yi, Xiaoqian Shen, Yunhao Gou, Mohamed Elhoseiny

The main question we address in this paper is how to scale up visual recognition of unseen classes, also known as zero-shot learning, to tens of thousands of categories as in the ImageNet-21K benchmark.

Image Classification Zero-Shot Image Classification +1

Domain-Aware Continual Zero-Shot Learning

no code implementations24 Dec 2021 Kai Yi, Paul Janson, Wenxuan Zhang, Mohamed Elhoseiny

Accordingly, we propose a Domain-Invariant Network (DIN) to learn factorized features for shifting domains and improved textual representation for unseen classes.

Disentanglement Zero-Shot Learning

Disentangling semantic features of macromolecules in Cryo-Electron Tomography

no code implementations27 Jun 2021 Kai Yi, Jianye Pang, Yungeng Zhang, Xiangrui Zeng, Min Xu

Cryo-electron tomography (Cryo-ET) is a 3D imaging technique that enables the systemic study of shape, abundance, and distribution of macromolecular structures in single cells in near-atomic resolution.

Electron Tomography

Imaginative Walks: Generative Random Walk Deviation Loss for Improved Unseen Learning Representation

1 code implementation20 Apr 2021 Divyansh Jha, Kai Yi, Ivan Skorokhodov, Mohamed Elhoseiny

By generating representations of unseen classes based on their semantic descriptions, e. g., attributes or text, generative ZSL attempts to differentiate unseen from seen categories.

Attribute Image Generation +1

VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning

1 code implementation CVPR 2022 Jun Chen, Han Guo, Kai Yi, Boyang Li, Mohamed Elhoseiny

To the best of our knowledge, this is the first work that improves data efficiency of image captioning by utilizing LM pretrained on unimodal data.

Image Captioning Language Modelling +1

CIZSL++: Creativity Inspired Generative Zero-Shot Learning

2 code implementations1 Jan 2021 Mohamed Elhoseiny, Kai Yi, Mohamed Elfeki

To improve the discriminative power of ZSL, we model the visual learning process of unseen categories with inspiration from the psychology of human creativity for producing novel art.

Attribute Transfer Learning +1

Experimental Analysis of Legendre Decomposition in Machine Learning

no code implementations12 Aug 2020 Jianye Pang, Kai Yi, Wanguang Yin, Min Xu

In this technical report, we analyze Legendre decomposition for non-negative tensor in theory and application.

BIG-bench Machine Learning Clustering

CosmoVAE: Variational Autoencoder for CMB Image Inpainting

1 code implementation31 Jan 2020 Kai Yi, Yi Guo, Yanan Fan, Jan Hamann, Yu Guang Wang

The noise of the CMB map has a significant impact on the estimation precision for cosmological parameters.

Image Inpainting

Deep Learning Based Unsupervised and Semi-supervised Classification for Keratoconus

2 code implementations31 Jan 2020 Nicole Hallett, Kai Yi, Josef Dick, Christopher Hodge, Gerard Sutton, Yu Guang Wang, Jingjing You

Currently, there is no cure for keratoconus other than corneal transplantation for advanced stage keratoconus or corneal cross-linking, which can only halt KC progression.

General Classification

Feature Selective Small Object Detection via Knowledge-based Recurrent Attentive Neural Network

no code implementations13 Mar 2018 Kai Yi, Zhiqiang Jian, Shitao Chen, Nanning Zheng

At present, the performance of deep neural network in general object detection is comparable to or even surpasses that of human beings.

Autonomous Driving Decision Making +4

Cannot find the paper you are looking for? You can Submit a new open access paper.