Search Results for author: Shiyu Liu

Found 20 papers, 4 papers with code

VCISR: Blind Single Image Super-Resolution with Video Compression Synthetic Data

1 code implementation2 Nov 2023 Boyang Wang, Bowen Liu, Shiyu Liu, Fengyu Yang

In this work, we for the first time, present a video compression-based degradation model to synthesize low-resolution image data in the blind SISR task.

Image Compression Image Super-Resolution +3

Personalized Federated Learning via Amortized Bayesian Meta-Learning

no code implementations5 Jul 2023 Shiyu Liu, Shaogao Lv, Dun Zeng, Zenglin Xu, Hui Wang, Yue Yu

Federated learning is a decentralized and privacy-preserving technique that enables multiple clients to collaborate with a server to learn a global model without exposing their private data.

Meta-Learning Personalized Federated Learning +2

Robust Graph Structure Learning with the Alignment of Features and Adjacency Matrix

no code implementations5 Jul 2023 Shaogao Lv, Gang Wen, Shiyu Liu, Linsen Wei, Ming Li

Overall, our research highlights the importance of integrating feature and graph information alignment in GSL, as inspired by our derived theoretical result, and showcases the superiority of our approach in handling noisy graph structures through comprehensive experiments on real-world datasets.

Graph structure learning

Stability and Generalization of lp-Regularized Stochastic Learning for GCN

no code implementations20 May 2023 Shiyu Liu, Linsen Wei, Shaogao Lv, Ming Li

For a single-layer GCN, we establish an explicit theoretical understanding of GCN with the $\ell_p$-regularized stochastic learning by analyzing the stability of our SGD proximal algorithm.

Graph Learning

MMVC: Learned Multi-Mode Video Compression with Block-based Prediction Mode Selection and Density-Adaptive Entropy Coding

1 code implementation CVPR 2023 Bowen Liu, Yu Chen, Rakesh Chowdary Machineni, Shiyu Liu, Hun-Seok Kim

In this paper, we propose multi-mode video compression (MMVC), a block wise mode ensemble deep video compression framework that selects the optimal mode for feature domain prediction adapting to different motion patterns.

Benchmarking MS-SSIM +4

Stochastic Clustered Federated Learning

no code implementations2 Mar 2023 Dun Zeng, Xiangjing Hu, Shiyu Liu, Yue Yu, Qifan Wang, Zenglin Xu

Federated learning is a distributed learning framework that takes full advantage of private data samples kept on edge devices.

Federated Learning

AP: Selective Activation for De-sparsifying Pruned Neural Networks

no code implementations9 Dec 2022 Shiyu Liu, Rohan Ghosh, Dylan Tan, Mehul Motani

However, in network pruning, we find that the sparsity introduced by ReLU, which we quantify by a term called dynamic dead neuron rate (DNR), is not beneficial for the pruned network.

Network Pruning

Optimizing Learning Rate Schedules for Iterative Pruning of Deep Neural Networks

no code implementations9 Dec 2022 Shiyu Liu, Rohan Ghosh, John Tan Chong Min, Mehul Motani

(ii) In addition to the strong theoretical motivation, SILO is empirically optimal in the sense of matching an Oracle, which exhaustively searches for the optimal value of max_lr via grid search.

Network Pruning

Towards Better Long-range Time Series Forecasting using Generative Forecasting

no code implementations9 Dec 2022 Shiyu Liu, Rohan Ghosh, Mehul Motani

In this paper, we propose a new forecasting strategy called Generative Forecasting (GenF), which generates synthetic data for the next few time steps and then makes long-range forecasts based on generated and observed data.

Generative Adversarial Network Time Series +1

Improving Mutual Information based Feature Selection by Boosting Unique Relevance

no code implementations9 Dec 2022 Shiyu Liu, Mehul Motani

MRwMR-BUR-CLF further improves the classification performance by 3. 8%- 5. 5% (relative to MRwMR), and it also outperforms three popular classifier dependent feature selection methods.

feature selection

Encoded Gradients Aggregation against Gradient Leakage in Federated Learning

no code implementations26 May 2022 Dun Zeng, Shiyu Liu, Siqi Liang, Zonghang Li, Hui Wang, Irwin King, Zenglin Xu

However, privacy information could be leaked from uploaded gradients and be exposed to malicious attackers or an honest-but-curious server.

Federated Learning

Millimeter-Scale Ultra-Low-Power Imaging System for Intelligent Edge Monitoring

no code implementations9 Mar 2022 Andrea Bejarano-Carbo, Hyochan An, Kyojin Choo, Shiyu Liu, Qirui Zhang, Dennis Sylvester, David Blaauw, Hun-Seok Kim

Millimeter-scale embedded sensing systems have unique advantages over larger devices as they are able to capture, analyze, store, and transmit data at the source while being unobtrusive and covert.

Data Compression Event Detection +1

Towards Better Long-range Time Series Forecasting using Generative Adversarial Networks

no code implementations17 Oct 2021 Shiyu Liu, Rohan Ghosh, Mehul Motani

In this paper, we propose a new forecasting strategy called Generative Forecasting (GenF), which generates synthetic data for the next few time steps and then makes long-range forecasts based on generated and observed data.

Generative Adversarial Network Time Series +1

S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks

no code implementations17 Oct 2021 Shiyu Liu, Chong Min John Tan, Mehul Motani

We explore a new perspective on adapting the learning rate (LR) schedule to improve the performance of the ReLU-based network as it is iteratively pruned.

ByPE-VAE: Bayesian Pseudocoresets Exemplar VAE

1 code implementation NeurIPS 2021 Qingzhong Ai, Lirong He, Shiyu Liu, Zenglin Xu

To address this issue, we propose Bayesian Pseudocoresets Exemplar VAE (ByPE-VAE), a new variant of VAE with a prior based on Bayesian pseudocoreset.

Data Augmentation Density Estimation +2

Stein Variational Gradient Descent with Multiple Kernel

no code implementations20 Jul 2021 Qingzhong Ai, Shiyu Liu, Lirong He, Zenglin Xu

In practice, we notice that the kernel used in SVGD-based methods has a decisive effect on the empirical performance.

Computational Efficiency

Deep Learning in Latent Space for Video Prediction and Compression

1 code implementation CVPR 2021 Bowen Liu, Yu Chen, Shiyu Liu, Hun-Seok Kim

The proposed method first learns the efficient lower-dimensional latent space representation of each video frame and then performs inter-frame prediction in that latent domain.

Anomaly Detection Event Detection +3

Using Synthetic Data to Improve the Long-range Forecasting of Time Series Data

no code implementations1 Jan 2021 Shiyu Liu, Mehul Motani

Lastly, we conduct an ablation study to demonstrate the effectiveness of the cWGAN-GEP and the ITC algorithm.

Clustering Time Series +1

Long-range Prediction of Vital Signs Using Generative Boosting via LSTM Networks

no code implementations14 Nov 2019 Shiyu Liu, Mehul Motani

Vital signs including heart rate, respiratory rate, body temperature and blood pressure, are critical in the clinical decision making process.

Clustering Decision Making

Feature Selection Based on Unique Relevant Information for Health Data

no code implementations2 Dec 2018 Shiyu Liu, Mehul Motani

Feature selection, which searches for the most representative features in observed data, is critical for health data analysis.

feature selection

Cannot find the paper you are looking for? You can Submit a new open access paper.