Search Results for author: Zeyu Liu

Found 23 papers, 8 papers with code

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models

no code implementations20 Mar 2024 Zeyu Liu, Souvik Kundu, Anni Li, Junrui Wan, Lianghao Jiang, Peter Anthony Beerel

While compared in terms of runtime, AFLoRA can yield up to $1. 86\times$ improvement as opposed to similar PEFT alternatives.

Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering

no code implementations14 Mar 2024 Zeyu Liu, Weicong Liang, Zhanhao Liang, Chong Luo, Ji Li, Gao Huang, Yuhui Yuan

Visual text rendering poses a fundamental challenge for contemporary text-to-image generation models, with the core problem lying in text encoder deficiencies.

Text-to-Image Generation

LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Units

1 code implementation20 Jan 2024 Zeyu Liu, Gourav Datta, Anni Li, Peter Anthony Beerel

Moreover, we present a spiking version of this architecture, which introduces the benefit of states within the patch embedding and channel mixer modules while simultaneously reducing the computing complexity.

When Bio-Inspired Computing meets Deep Learning: Low-Latency, Accurate, & Energy-Efficient Spiking Neural Networks from Artificial Neural Networks

no code implementations12 Dec 2023 Gourav Datta, Zeyu Liu, James Diffenderfer, Bhavya Kailkhura, Peter A. Beerel

However, advanced ANN-to-SNN conversion approaches demonstrate that for lossless conversion, the number of SNN time steps must equal the number of quantization steps in the ANN activation function.

Quantization

COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Design

no code implementations28 Nov 2023 Peidong Jia, Chenxuan Li, Yuhui Yuan, Zeyu Liu, Yichao Shen, Bohan Chen, Xingru Chen, Yinglin Zheng, Dong Chen, Ji Li, Xiaodong Xie, Shanghang Zhang, Baining Guo

Our COLE system comprises multiple fine-tuned Large Language Models (LLMs), Large Multimodal Models (LMMs), and Diffusion Models (DMs), each specifically tailored for design-aware layer-wise captioning, layout planning, reasoning, and the task of generating images and text.

Image Generation

Spiking Neural Networks with Dynamic Time Steps for Vision Transformers

no code implementations28 Nov 2023 Gourav Datta, Zeyu Liu, Anni Li, Peter A. Beerel

Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved latency and energy efficiency, however, they target only convolutional neural networks (CNN).

Generating Progressive Images from Pathological Transitions via Diffusion Model

2 code implementations21 Nov 2023 Zeyu Liu, Tianyi Zhang, Yufang He, Yunlu Feng, Yu Zhao, Guanglei Zhang

Deep learning is widely applied in computer-aided pathological diagnosis, which alleviates the pathologist workload and provide timely clinical analysis.

Data Augmentation Medical Diagnosis

CPIA Dataset: A Comprehensive Pathological Image Analysis Dataset for Self-supervised Learning Pre-training

1 code implementation27 Oct 2023 Nan Ying, Yanli Lei, Tianyi Zhang, Shangqing Lyu, Chunhui Li, Sicheng Chen, Zeyu Liu, Yu Zhao, Guanglei Zhang

This paper presents the comprehensive pathological image analysis (CPIA) dataset, a large-scale SSL pre-training dataset combining 103 open-source datasets with extensive standardization.

Self-Supervised Learning Transfer Learning +1

Corporate Credit Rating: A Survey

no code implementations19 Sep 2023 Bojing Feng, Xi Cheng, Dan Li, Zeyu Liu, Wenfang Xue

Corporate credit rating (CCR) plays a very important role in the process of contemporary economic and social development.

Latency-aware Unified Dynamic Networks for Efficient Image Recognition

1 code implementation30 Aug 2023 Yizeng Han, Zeyu Liu, Zhihang Yuan, Yifan Pu, Chaofei Wang, Shiji Song, Gao Huang

Dynamic computation has emerged as a promising avenue to enhance the inference efficiency of deep networks.

Scheduling

Dynamic Perceiver for Efficient Visual Recognition

1 code implementation ICCV 2023 Yizeng Han, Dongchen Han, Zeyu Liu, Yulin Wang, Xuran Pan, Yifan Pu, Chao Deng, Junlan Feng, Shiji Song, Gao Huang

Early exits are placed exclusively within the classification branch, thus eliminating the need for linear separability in low-level features.

Action Recognition Classification +4

In-Sensor & Neuromorphic Computing are all you need for Energy Efficient Computer Vision

no code implementations21 Dec 2022 Gourav Datta, Zeyu Liu, Md Abdullah-Al Kaiser, Souvik Kundu, Joe Mathai, Zihan Yin, Ajey P. Jacob, Akhilesh R. Jaiswal, Peter A. Beerel

Although the overhead for the first layer MACs with direct encoding is negligible for deep SNNs and the CV processing is efficient using SNNs, the data transfer between the image sensors and the downstream processing costs significant bandwidth and may dominate the total energy.

Total Energy

Hoyer regularizer is all you need for ultra low-latency spiking neural networks

no code implementations20 Dec 2022 Gourav Datta, Zeyu Liu, Peter A. Beerel

Spiking Neural networks (SNN) have emerged as an attractive spatio-temporal computing paradigm for a wide range of low-power vision tasks.

object-detection Object Detection

Enabling ISP-less Low-Power Computer Vision

no code implementations11 Oct 2022 Gourav Datta, Zeyu Liu, Zihan Yin, Linyu Sun, Akhilesh R. Jaiswal, Peter A. Beerel

However, direct inference on the raw images degrades the test accuracy due to the difference in covariance of the raw images captured by the image sensors compared to the ISP-processed images used for training.

Demosaicking Few-Shot Learning

A multi view multi stage and multi window framework for pulmonary artery segmentation from CT scans

no code implementations8 Sep 2022 Zeyu Liu, Yi Wang, Jing Wen, Yong Zhang, Hao Yin, Chao Guo, Zhongyu Wang

In addition, in order to improve the segmentation performance, we adopt multi-view and multi-window level method, at the same time we employ a fine-tune strategy to mitigate the impact of inconsistent labeling.

Segmentation

Risk Assessment with Generic Energy Storage under Exogenous and Endogenous Uncertainty

no code implementations26 Mar 2022 Ning Qi, Lin Cheng, Yuxiang Wan, Yingrui Zhuang, Zeyu Liu

Current risk assessment ignores the stochastic nature of energy storage availability itself and thus lead to potential risk during operation.

Every Corporation Owns Its Image: Corporate Credit Ratings via Convolutional Neural Networks

no code implementations3 Dec 2020 Bojing Feng, Wenfang Xue, Bindang Xue, Zeyu Liu

Credit rating is an analysis of the credit risks associated with a corporation, which reflect the level of the riskiness and reliability in investing.

BIG-bench Machine Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.