Search Results for author: Jie Liang

Found 40 papers, 13 papers with code

SSL: A Self-similarity Loss for Improving Generative Image Super-resolution

1 code implementation11 Aug 2024 Du Chen, Zhengqiang Zhang, Jie Liang, Lei Zhang

Based on the fact that natural images exhibit high self-similarities, i. e., a local patch can have many similar patches to it in the whole image, in this work we propose a simple yet effective self-similarity loss (SSL) to improve the performance of generative Real-ISR models, enhancing the hallucination of structural and textural details while reducing the unpleasant visual artifacts.

Hallucination Image Super-Resolution

LORTSAR: Low-Rank Transformer for Skeleton-based Action Recognition

no code implementations19 Jul 2024 Soroush Oraki, Harry Zhuang, Jie Liang

The complexity of state-of-the-art Transformer-based models for skeleton-based action recognition poses significant challenges in terms of computational efficiency and resource utilization.

Action Recognition Computational Efficiency +3

ALPHAGMUT: A Rationale-Guided Alpha Shape Graph Neural Network to Evaluate Mutation Effects

no code implementations13 Jun 2024 Boshen Wang, Bowei Ye, Lin Xu, Jie Liang

In this study, we introduce a novel rationale-guided graph neural network AlphaGMut to evaluate mutation effects and to distinguish pathogenic mutations from neutral mutations.

Graph Neural Network

When Fuzzing Meets LLMs: Challenges and Opportunities

no code implementations25 Apr 2024 Yu Jiang, Jie Liang, Fuchen Ma, Yuanliang Chen, Chijin Zhou, Yuheng Shen, Zhiyong Wu, Jingzhou Fu, Mingzhe Wang, Shanshan Li, Quan Zhang

Fuzzing, a widely-used technique for bug detection, has seen advancements through Large Language Models (LLMs).

A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment

1 code implementation16 Mar 2024 Tianhe Wu, Kede Ma, Jie Liang, Yujiu Yang, Lei Zhang

While Multimodal Large Language Models (MLLMs) have experienced significant advancement in visual understanding and reasoning, their potential to serve as powerful, flexible, interpretable, and text-driven models for Image Quality Assessment (IQA) remains largely unexplored.

Image Quality Assessment

Perception-Distortion Balanced Super-Resolution: A Multi-Objective Optimization Perspective

1 code implementation24 Dec 2023 Lingchen Sun, Jie Liang, Shuaizheng Liu, Hongwei Yong, Lei Zhang

High perceptual quality and low distortion degree are two important goals in image restoration tasks such as super-resolution (SR).

Image Restoration Super-Resolution

Guided Image Restoration via Simultaneous Feature and Image Guided Fusion

no code implementations14 Dec 2023 Xinyi Liu, Qian Zhao, Jie Liang, Hui Zeng, Deyu Meng, Lei Zhang

Currently, joint image filtering-inspired deep learning-based methods represent the state-of-the-art for GIR tasks.

Depth Map Super-Resolution Image Restoration

MRGazer: Decoding Eye Gaze Points from Functional Magnetic Resonance Imaging in Individual Space

no code implementations22 Nov 2023 Xiuwen Wu, Rongjie Hu, Jie Liang, Yanming Wang, Bensheng Qiu, Xiaoxiao Wang

Compared to the previous method, the proposed framework skips the fMRI co-registration step, simplifies the processing protocol and achieves end-to-end eye gaze regression.

Gaze Prediction

Enhanced Residual SwinV2 Transformer for Learned Image Compression

no code implementations23 Aug 2023 Yongqiang Wang, Feng Liang, Haisheng Fu, Jie Liang, Haipeng Qin, Junzhe Liang

In particular, our method achieves comparable results while reducing model complexity by 56% compared to these recent methods.

Image Compression

ROI-based Deep Image Compression with Swin Transformers

no code implementations12 May 2023 Binglin Li, Jie Liang, Haisheng Fu, Jingning Han

Encoding the Region Of Interest (ROI) with better quality than the background has many applications including video conferencing systems, video surveillance and object-oriented vision tasks.

Image Compression Instance Segmentation +3

Human Guided Ground-truth Generation for Realistic Image Super-resolution

1 code implementation CVPR 2023 Du Chen, Jie Liang, Xindong Zhang, Ming Liu, Hui Zeng, Lei Zhang

A human guided GT image dataset with both positive and negative samples is then constructed, and a loss function is proposed to train the Real-ISR models.

Image Enhancement Image Super-Resolution

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Map, and Post-Quantization Filtering

no code implementations21 Jun 2022 Haisheng Fu, Feng Liang, Jie Liang, Binglin Li, Guohe Zhang, Jingning Han

Based on this observation, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only needs one stage of MSRB to yield satisfactory reconstruction, thereby reducing the decoding complexity without sacrifcing performance.

Decoder Image Compression +1

Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolution

1 code implementation27 Mar 2022 Jie Liang, Hui Zeng, Lei Zhang

Specifically, a tiny regression network is employed to predict the degradation parameters of the input image, while several convolutional experts with the same topology are jointly optimized to specify the network parameters via a non-linear mixture of experts.

Image Super-Resolution

Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolution

2 code implementations CVPR 2022 Jie Liang, Hui Zeng, Lei Zhang

In this paper, we demonstrate that it is possible to train a GAN-based SISR model which can stably generate perceptually realistic details while inhibiting visual artifacts.

Image Super-Resolution

SeqMapPDB: A Standalone Pipeline to Identify Representative Structures of Protein Sequences and Mapping Residue Indices in Real-Time at Proteome Scale

no code implementations23 Feb 2022 Boshen Wang, Xue Lei, Wei Tian, Alan Perez-Rathke, Yan-Yuan Tseng, Jie Liang

Furthermore, SeqMapPDB provides the flexibility of a stand-alone pipeline for large scale mapping of in-house sequence and structure data.

Auto-Weighted Layer Representation Based View Synthesis Distortion Estimation for 3-D Video Coding

no code implementations7 Jan 2022 Jian Jin, Xingxing Zhang, Lili Meng, Weisi Lin, Jie Liang, Huaxiang Zhang, Yao Zhao

Experimental results show that the VSD can be accurately estimated with the weights learnt by the nonlinear mapping function once its associated S-VSDs are available.

PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistency

1 code implementation CVPR 2021 Jie Liang, Hui Zeng, Miaomiao Cui, Xuansong Xie, Lei Zhang

HRP requires that more attention should be paid to human regions, while GLC requires that a group of portrait photos should be retouched to a consistent tone.

Photo Retouching

High-Resolution Photorealistic Image Translation in Real-Time: A Laplacian Pyramid Translation Network

1 code implementation CVPR 2021 Jie Liang, Hui Zeng, Lei Zhang

Existing image-to-image translation (I2IT) methods are either constrained to low-resolution images or long inference time due to their heavy computational burden on the convolution of high-resolution feature maps.

4k Attribute +4

Exact Topology of Dynamic Probability Surface of an Activated Process by Persistent Homology

no code implementations31 Jan 2021 Farid Manuchehrfar, Huiyu Li, Wei Tian, Ao Ma, Jie Liang

To gain insight into reaction mechanism of activated processes, we introduce an exact approach for quantifying the topology of high-dimensional probability surfaces of the underlying dynamic processes.

Mathematical Physics Mathematical Physics

A Multi-task Joint Framework for Real-time Person Search

no code implementations11 Dec 2020 Ye Li, Kangning Yin, Jie Liang, Chunyu Wang, Guangqiang Yin

To solve these problems, we propose a Multi-task Joint Framework for real-time person search (MJF), which optimizes the person detection, feature extraction and identity comparison respectively.

Human Detection Person Search

Deep Learning-based Image Compression with Trellis Coded Quantization

no code implementations26 Jan 2020 Binglin Li, Mohammad Akbari, Jie Liang, Yang Wang

Recently many works attempt to develop image compression models based on deep learning architectures, where the uniform scalar quantizer (SQ) is commonly applied to the feature maps between the encoder and decoder.

Decoder Deep Learning +2

Learned Variable-Rate Image Compression with Residual Divisive Normalization

no code implementations11 Dec 2019 Mohammad Akbari, Jie Liang, Jingning Han, Chengjie Tu

Recently it has been shown that deep learning-based image compression has shown the potential to outperform traditional codecs.

Decoder Image Compression +1

Simultaneous Subspace Clustering and Cluster Number Estimating based on Triplet Relationship

no code implementations23 Jan 2019 Jie Liang, Jufeng Yang, Ming-Ming Cheng, Paul L. Rosin, Liang Wang

In this paper we propose a unified framework to simultaneously discover the number of clusters and group the data points into them using subspace clustering.

Clustering Model Selection +1

Sub-GAN: An Unsupervised Generative Model via Subspaces

no code implementations ECCV 2018 Jie Liang, Jufeng Yang, Hsin-Ying Lee, Kai Wang, Ming-Hsuan Yang

The recent years have witnessed significant growth in constructing robust generative models to capture informative distributions of natural data.

Generative Adversarial Network

EnFuzz: From Ensemble Learning to Ensemble Fuzzing

no code implementations30 Jun 2018 Yuanliang Chen, Yu Jiang, Jie Liang, Mingzhe Wang, Xun Jiao

For evaluation, we implement EnFuzz , a prototype basing on four strong open-source fuzzers (AFL, AFLFast, AFLGo, FairFuzz), and test them on Google's fuzzing test suite, which consists of widely used real-world applications.

Software Engineering

DSSLIC: Deep Semantic Segmentation-based Layered Image Compression

2 code implementations8 Jun 2018 Mohammad Akbari, Jie Liang, Jingning Han

A compact representation of the input image is also generated and encoded as the first enhancement layer.

Image Compression Image Retrieval +4

Semi-Recurrent CNN-based VAE-GAN for Sequential Data Generation

1 code implementation1 Jun 2018 Mohammad Akbari, Jie Liang

A semi-recurrent hybrid VAE-GAN model for generating sequential data is introduced.

Music Generation

Clinical Skin Lesion Diagnosis Using Representations Inspired by Dermatologist Criteria

no code implementations CVPR 2018 Jufeng Yang, Xiaoxiao Sun, Jie Liang, Paul L. Rosin

Accordingly, we design six medical representations considering different criteria for the recognition of skin lesions, and construct a diagnosis system for clinical skin disease images.

Simultaneously Color-Depth Super-Resolution with Conditional Generative Adversarial Network

no code implementations30 Aug 2017 Lijun Zhao, Huihui Bai, Jie Liang, Bing Zeng, Anhong Wang, Yao Zhao

Firstly, given the low-resolution depth image and low-resolution color image, a generative network is proposed to leverage mutual information of color image and depth image to enhance each other in consideration of the geometry structural dependency of color-depth image in the same scene.

Edge Detection Generative Adversarial Network +5

Local Activity-tuned Image Filtering for Noise Removal and Image Smoothing

no code implementations9 Jul 2017 Lijun Zhao, Jie Liang, Huihui Bai, Lili Meng, Anhong Wang, Yao Zhao

Both frameworks employ the division of gradient and the local activity measurement to achieve noise removal.

Image Denoising image smoothing

Scalable Compression of Deep Neural Networks

no code implementations26 Aug 2016 Xing Wang, Jie Liang

Deep neural networks generally involve some layers with mil- lions of parameters, making them difficult to be deployed and updated on devices with limited resources such as mobile phones and other smart embedded systems.

Cannot find the paper you are looking for? You can Submit a new open access paper.