Search Results for author: Jiangshe Zhang

Found 32 papers, 15 papers with code

Seismic First Break Picking in a Higher Dimension Using Deep Graph Learning

no code implementations12 Apr 2024 Hongtao Wang, Li Long, Jiangshe Zhang, Xiaoli Wei, Chunxia Zhang, Zhenbo Guo

Addressing this, we propose a novel approach using deep graph learning called DGL-FB, constructing a large graph to efficiently extract information.

Graph Learning

Image Fusion via Vision-Language Model

no code implementations3 Feb 2024 Zixiang Zhao, Lilun Deng, Haowen Bai, Yukun Cui, Zhipeng Zhang, Yulun Zhang, Haotong Qin, Dongdong Chen, Jiangshe Zhang, Peng Wang, Luc van Gool

Therefore, we introduce a novel fusion paradigm named image Fusion via vIsion-Language Model (FILM), for the first time, utilizing explicit textual information in different source images to guide image fusion.

Language Modelling

Stabilizing Sharpness-aware Minimization Through A Simple Renormalization Strategy

no code implementations14 Jan 2024 Chengli Tan, Jiangshe Zhang, Junmin Liu, Yicheng Wang, Yunda Hao

Recently, sharpness-aware minimization (SAM) has attracted a lot of attention because of its surprising effectiveness in improving generalization performance. However, training neural networks with SAM can be highly unstable since the loss does not decrease along the direction of the exact gradient at the current point, but instead follows the direction of a surrogate gradient evaluated at another point nearby.

Learning Theory

ReFusion: Learning Image Fusion from Reconstruction with Learnable Loss via Meta-Learning

no code implementations13 Dec 2023 Haowen Bai, Zixiang Zhao, Jiangshe Zhang, Yichen Wu, Lilun Deng, Yukun Cui, Shuang Xu, Baisong Jiang

To ensure the fusion module maximally preserves the information from the source images, enabling the reconstruction of the source images from the fused image, we adopt a meta-learning strategy to train the loss proposal module using reconstruction loss.

Meta-Learning Multi-Exposure Image Fusion

Seismic Data Interpolation based on Denoising Diffusion Implicit Models with Resampling

no code implementations9 Jul 2023 Xiaoli Wei, Chunxia Zhang, Hongtao Wang, Chengli Tan, Deng Xiong, Baisong Jiang, Jiangshe Zhang, Sang-Woon Kim

The model training is established on the denoising diffusion probabilistic model, where U-Net is equipped with the multi-head self-attention to match the noise in each step.

Denoising Uncertainty Quantification

Equivariant Multi-Modality Image Fusion

2 code implementations19 May 2023 Zixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang, Kai Zhang, Shuang Xu, Dongdong Chen, Radu Timofte, Luc van Gool

These components enable the net training to follow the principles of the natural sensing-imaging process while satisfying the equivariant imaging prior.

Self-Supervised Learning

DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion

2 code implementations ICCV 2023 Zixiang Zhao, Haowen Bai, Yuanzhi Zhu, Jiangshe Zhang, Shuang Xu, Yulun Zhang, Kai Zhang, Deyu Meng, Radu Timofte, Luc van Gool

To leverage strong generative priors and address challenges such as unstable training and lack of interpretability for GAN-based generative methods, we propose a novel fusion algorithm based on the denoising diffusion probabilistic model (DDPM).

Denoising

Information Theoretical Importance Sampling Clustering

no code implementations9 Feb 2023 Jiangshe Zhang, Lizhen Ji, Meng Wang

In this paper, we propose an information theoretical importance sampling based approach for clustering problems (ITISC) which minimizes the worst case of expected distortions under the constraint of distribution deviation.

Clustering Load Forecasting

An information-theoretic learning model based on importance sampling

no code implementations9 Feb 2023 Jiangshe Zhang, Lizhen Ji, Fei Gao, Mengyao Li

A crucial assumption underlying the most current theory of machine learning is that the training distribution is identical to the test distribution.

Face Verification

CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion

2 code implementations CVPR 2023 Zixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang, Shuang Xu, Zudi Lin, Radu Timofte, Luc van Gool

We then introduce a dual-branch Transformer-CNN feature extractor with Lite Transformer (LT) blocks leveraging long-range attention to handle low-frequency global features and Invertible Neural Networks (INN) blocks focusing on extracting high-frequency local information.

object-detection Object Detection +1

MSSPN: Automatic First Arrival Picking using Multi-Stage Segmentation Picking Network

no code implementations7 Sep 2022 Hongtao Wang, Jiangshe Zhang, Xiaoli Wei, Chunxia Zhang, Zhenbo Guo, Li Long, Yicheng Wang

Besides, since the gather data is a set of signals which are greatly different from the natural images, it is difficult for the current method to solve the FAT picking problem in case of a low Signal to Noise Ratio (SNR).

Trajectory-dependent Generalization Bounds for Deep Neural Networks via Fractional Brownian Motion

1 code implementation9 Jun 2022 Chengli Tan, Jiangshe Zhang, Junmin Liu

In this study, we argue that the hypothesis set SGD explores is trajectory-dependent and thus may provide a tighter bound over its Rademacher complexity.

Generalization Bounds

Understanding Short-Range Memory Effects in Deep Neural Networks

1 code implementation5 May 2021 Chengli Tan, Jiangshe Zhang, Junmin Liu

Instead, inspired by the short-range correlation emerging in the SGN series, we propose that SGD can be viewed as a discretization of an SDE driven by fractional Brownian motion (FBM).

Discrete Cosine Transform Network for Guided Depth Map Super-Resolution

2 code implementations CVPR 2022 Zixiang Zhao, Jiangshe Zhang, Shuang Xu, Zudi Lin, Hanspeter Pfister

Guided depth super-resolution (GDSR) is an essential topic in multi-modal image processing, which reconstructs high-resolution (HR) depth maps from low-resolution ones collected with suboptimal conditions with the help of HR RGB images of the same scene.

Depth Map Super-Resolution

Deep Gradient Projection Networks for Pan-sharpening

1 code implementation CVPR 2021 Shuang Xu, Jiangshe Zhang, Zixiang Zhao, Kai Sun, Junmin Liu, Chunxia Zhang

Specifically, two optimization problems regularized by the deep prior are formulated, and they are separately responsible for the generative models for panchromatic images and low resolution multispectral images.

Towards Reducing Severe Defocus Spread Effects for Multi-Focus Image Fusion via an Optimization Based Strategy

1 code implementation29 Dec 2020 Shuang Xu, Lizhen Ji, Zhe Wang, Pengfei Li, Kai Sun, Chunxia Zhang, Jiangshe Zhang

According to the idea that each local region in the fused image should be similar to the sharpest one among source images, this paper presents an optimization-based approach to reduce defocus spread effects.

SSIM

Domain Adaptive Object Detection via Feature Separation and Alignment

no code implementations16 Dec 2020 Chengyang Liang, Zixiang Zhao, Junmin Liu, Jiangshe Zhang

Notably, scale-space filtering is exploited to implement adaptive searching for regions to be aligned, and instance-level features in each region are refined to reduce redundancy and noise mentioned in the second issue.

object-detection Object Detection

MFIF-GAN: A New Generative Adversarial Network for Multi-Focus Image Fusion

no code implementations21 Sep 2020 Yicheng Wang, Shuang Xu, Junmin Liu, Zixiang Zhao, Chun-Xia Zhang, Jiangshe Zhang

Multi-Focus Image Fusion (MFIF) is a promising image enhancement technique to obtain all-in-focus images meeting visual needs and it is a precondition of other computer vision tasks.

Generative Adversarial Network Image Enhancement

When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method

no code implementations2 Sep 2020 Zixiang Zhao, Jiangshe Zhang, Shuang Xu, Kai Sun, Chunxia Zhang, Junmin Liu

The core idea is that the encoder decomposes an image into base and detail feature maps with low- and high-frequency information, respectively, and that the decoder is responsible for the original image reconstruction.

Image Enhancement Image Reconstruction +1

Deep Convolutional Sparse Coding Networks for Image Fusion

2 code implementations18 May 2020 Shuang Xu, Zixiang Zhao, Yicheng Wang, Chun-Xia Zhang, Junmin Liu, Jiangshe Zhang

Image fusion is a significant problem in many fields including digital photography, computational imaging and remote sensing, to name but a few.

Infrared And Visible Image Fusion Multi-Exposure Image Fusion

Bayesian Fusion for Infrared and Visible Images

2 code implementations12 May 2020 Zixiang Zhao, Shuang Xu, Chun-Xia Zhang, Junmin Liu, Jiangshe Zhang

In this paper, a novel Bayesian fusion model is established for infrared and visible images.

Infrared And Visible Image Fusion

Efficient and Model-Based Infrared and Visible Image Fusion Via Algorithm Unrolling

no code implementations12 May 2020 Zixiang Zhao, Shuang Xu, Jiangshe Zhang, Chengyang Liang, Chunxia Zhang, Junmin Liu

The proposed AUIF model starts with the iterative formulas of two traditional optimization models, which are established to accomplish two-scale decomposition, i. e., separating low-frequency base information and high-frequency detail information from source images.

Infrared And Visible Image Fusion Rolling Shutter Correction

DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion

2 code implementations20 Mar 2020 Zixiang Zhao, Shuang Xu, Chun-Xia Zhang, Junmin Liu, Pengfei Li, Jiangshe Zhang

Infrared and visible image fusion, a hot topic in the field of image processing, aims at obtaining fused images keeping the advantages of source images.

Infrared And Visible Image Fusion Semantic Segmentation

MFFW: A new dataset for multi-focus image fusion

no code implementations12 Feb 2020 Shuang Xu, Xiaoli Wei, Chunxia Zhang, Junmin Liu, Jiangshe Zhang

It is found that current methods are evaluated on simulated image sets or Lytro dataset.

Toward a Controllable Disentanglement Network

1 code implementation22 Jan 2020 Zengjie Song, Oluwasanmi Koyejo, Jiangshe Zhang

By exploring the real-valued space of the soft target representation, we are able to synthesize novel images with the designated properties.

Disentanglement Generative Adversarial Network

Learning Controllable Disentangled Representations with Decorrelation Regularization

no code implementations25 Dec 2019 Zengjie Song, Oluwasanmi Koyejo, Jiangshe Zhang

By exploiting the real-valued space of the soft target representations, we are able to synthesize novel images with the designated properties.

Disentanglement

Adaptive Quantile Low-Rank Matrix Factorization

1 code implementation1 Jan 2019 Shuang Xu, Chun-Xia Zhang, Jiangshe Zhang

By assuming noise to come from a Gaussian, Laplace or mixture of Gaussian distributions, significant efforts have been made on optimizing the (weighted) $L_1$ or $L_2$-norm loss between an observed matrix and its bilinear factorization.

Cannot find the paper you are looking for? You can Submit a new open access paper.