Search Results for author: Zhengxia Zou

Found 53 papers, 28 papers with code

Kolmogorov Arnold Neural Interpolator for Downscaling and Correcting Meteorological Fields from In-Situ Observations

no code implementations24 Jan 2025 Zili Liu, Hao Chen, Lei Bai, Wenyuan Li, Zhengxia Zou, Zhenwei Shi

Obtaining accurate weather forecasts at station locations is a critical challenge due to systematic biases arising from the mismatch between multi-scale, continuous atmospheric characteristic and their discrete, gridded representations.

WSSM: Geographic-enhanced hierarchical state-space model for global station weather forecast

no code implementations20 Jan 2025 Songru Yang, Zili Liu, Zhenwei Shi, Zhengxia Zou

Global Station Weather Forecasting (GSWF), a prominent meteorological research area, is pivotal in providing timely localized weather predictions.

Mamba State Space Models +1

RSRefSeg: Referring Remote Sensing Image Segmentation with Foundation Models

1 code implementation12 Jan 2025 Keyan Chen, Jiafan Zhang, Chenyang Liu, Zhengxia Zou, Zhenwei Shi

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications.

Image Segmentation Segmentation +1

Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Model

no code implementations1 Jan 2025 Chenyang Liu, Keyan Chen, Rui Zhao, Zhengxia Zou, Zhenwei Shi

On the previous benchmark dataset, Text2Earth outperforms previous models with an improvement of +26. 23 FID and +20. 95% Zero-shot Cls-OA metric. Our project page is \url{https://chen-yang-liu. github. io/Text2Earth}

Image Generation

Efficient Semantic Splatting for Remote Sensing Multi-view Segmentation

no code implementations8 Dec 2024 Zipeng Qi, Hao Chen, Haotian Zhang, Zhengxia Zou, Zhenwei Shi

In this paper, we propose a novel semantic splatting approach based on Gaussian Splatting to achieve efficient and low-latency.

Semantic Segmentation

Remote Sensing Temporal Vision-Language Models: A Comprehensive Survey

1 code implementation3 Dec 2024 Chenyang Liu, Jiafan Zhang, Keyan Chen, Man Wang, Zhengxia Zou, Zhenwei Shi

This survey fills a critical gap in the literature by providing an integrated overview of RSTVLM, offering a foundation for further advancements in remote sensing temporal image understanding.

Change Detection Descriptive +4

MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling

no code implementations20 Aug 2024 Zili Liu, Hao Chen, Lei Bai, Wenyuan Li, Wanli Ouyang, Zhengxia Zou, Zhenwei Shi

In an era of frequent extreme weather and global warming, obtaining precise, fine-grained near-surface weather forecasts is increasingly essential for human activities.

Mamba Super-Resolution

Open-CD: A Comprehensive Toolbox for Change Detection

1 code implementation22 Jul 2024 Kaiyu Li, Jiawei Jiang, Andrea Codegoni, Chengxi Han, Yupeng Deng, Keyan Chen, Zhuo Zheng, Hao Chen, Zhengxia Zou, Zhenwei Shi, Sheng Fang, Deyu Meng, Zhi Wang, Xiangyong Cao

We present Open-CD, a change detection toolbox that contains a rich set of change detection methods as well as related components and modules.

Benchmarking Change Detection

A Late-Stage Bitemporal Feature Fusion Network for Semantic Change Detection

1 code implementation15 Jun 2024 Chenyao Zhou, Haotian Zhang, Han Guo, Zhengxia Zou, Zhenwei Shi

Recently some multi-task learning based semantic change detection methods have been proposed to decompose the task into semantic segmentation and binary change detection subtasks.

Change Detection Earth Observation +2

CDMamba: Remote Sensing Image Change Detection with Mamba

3 code implementations6 Jun 2024 Haotian Zhang, Keyan Chen, Chenyang Liu, Hao Chen, Zhengxia Zou, Zhenwei Shi

Specifically, the Scaled Residual ConvMamba (SRCM) block is proposed to utilize the ability of Mamba to extract global features and convolution to enhance the local details, to alleviate the issue that current Mamba-based methods lack detailed clues and are difficult to achieve fine detection in dense prediction tasks.

Change Detection Mamba +1

Multi-view Remote Sensing Image Segmentation With SAM priors

no code implementations23 May 2024 Zipeng Qi, Chenyang Liu, Zili Liu, Hao Chen, Yongchang Wu, Zhengxia Zou, Zhenwei Sh

Subsequently, we introduce SAM features via a transformer into the INF of the scene, supplementing the semantic information.

Image Segmentation Semantic Segmentation

MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation

no code implementations22 May 2024 Zhiping Yu, Chenyang Liu, Liqin Liu, Zhenwei Shi, Zhengxia Zou

To achieve unbounded and arbitrary-sized image generation, we design a novel noise sampling strategy for denoising diffusion models by analyzing the generation conditions and initial noise.

Denoising Image Generation

RSCaMa: Remote Sensing Image Change Captioning with State Space Model

1 code implementation29 Apr 2024 Chenyang Liu, Keyan Chen, Bowen Chen, Haotian Zhang, Zhengxia Zou, Zhenwei Shi

In terms of efficient temporal modeling, considering the potential correlation between the temporal scanning characteristics of Mamba and the temporality of the RSICC, we propose the Temporal-Traversing SSM (TT-SSM), which scans bi-temporal features in a temporal cross-wise manner, enhancing the model's temporal understanding and information interaction.

Decoder Mamba

Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysis

1 code implementation28 Mar 2024 Chenyang Liu, Keyan Chen, Haotian Zhang, Zipeng Qi, Zhengxia Zou, Zhenwei Shi

Remote sensing satellite imagery offers a unique perspective for monitoring these changes, leading to the emergence of remote sensing image change interpretation (RSICI) as a significant research focus.

Change Detection Language Modelling +2

RSMamba: Remote Sensing Image Classification with State Space Model

3 code implementations28 Mar 2024 Keyan Chen, Bowen Chen, Chenyang Liu, Wenyuan Li, Zhengxia Zou, Zhenwei Shi

Remote sensing image classification forms the foundation of various understanding tasks, serving a crucial function in remote sensing image interpretation.

Classification Image Classification +3

BiFA: Remote Sensing Image Change Detection With Bitemporal Feature Alignment

1 code implementation IEEE Transactions on Geoscience and Remote Sensing 2024 Haotian Zhang, Hao Chen, Chenyao Zhou, Keyan Chen, Chenyang Liu, Zhengxia Zou, Zhenwei Shi

Despite the success of deep learning-based change detection (CD) methods, their existing insufficiency in temporal (channel and spatial) and multiscale alignment has rendered them insufficient capability in mitigating external factors (illumination changes and perspective differences) arising from different imaging conditions during CD.

Change Detection

Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method

1 code implementation22 Jan 2024 Zili Liu, Hao Chen, Lei Bai, Wenyuan Li, Keyan Chen, Zhengyi Wang, Wanli Ouyang, Zhengxia Zou, Zhenwei Shi

In this paper, we extend meteorological downscaling to arbitrary scattered station scales, establish a brand new benchmark and dataset, and retrieve meteorological states at any given station location from a coarse-resolution meteorological field.

Super-Resolution Weather Forecasting

Learning to detect cloud and snow in remote sensing images from noisy labels

no code implementations17 Jan 2024 Zili Liu, Hao Chen, Wenyuan Li, Keyan Chen, Zipeng Qi, Chenyang Liu, Zhengxia Zou, Zhenwei Shi

This paper is the first to consider the impact of label noise on the detection of clouds and snow in remote sensing images.

Diversity Semantic Segmentation

DeepPhysiNet: Bridging Deep Learning and Atmospheric Physics for Accurate and Continuous Weather Modeling

1 code implementation4 Jan 2024 Wenyuan Li, Zili Liu, Keyan Chen, Hao Chen, Shunlin Liang, Zhengxia Zou, Zhenwei Shi

Next, we construct hyper-networks based on deep learning methods to directly learn weather patterns from a large amount of meteorological data.

Weather Forecasting

Pixel-Level Change Detection Pseudo-Label Learning for Remote Sensing Change Captioning

no code implementations23 Dec 2023 Chenyang Liu, Keyan Chen, Zipeng Qi, Haotian Zhang, Zhengxia Zou, Zhenwei Shi

The existing methods for Remote Sensing Image Change Captioning (RSICC) perform well in simple scenes but exhibit poorer performance in complex scenes.

Change Detection Pseudo Label

High-Quality 3D Face Reconstruction with Affine Convolutional Networks

no code implementations22 Oct 2023 Zhiqian Lin, Jiangke Lin, Lincheng Li, Yi Yuan, Zhengxia Zou

In our method, an affine transformation matrix is learned from the affine convolution layer for each spatial location of the feature maps.

3D Face Reconstruction Decoder

MSight: An Edge-Cloud Infrastructure-based Perception System for Connected Automated Vehicles

no code implementations8 Oct 2023 Rusheng Zhang, Depu Meng, Shengyin Shen, Zhengxia Zou, Houqiang Li, Henry X. Liu

As vehicular communication and networking technologies continue to advance, infrastructure-based roadside perception emerges as a pivotal tool for connected automated vehicle (CAV) applications.

Trajectory Prediction

Zero-Shot Image Harmonization with Generative Model Prior

1 code implementation17 Jul 2023 Jianqi Chen, Yilan Zhang, Zhengxia Zou, Keyan Chen, Zhenwei Shi

Initially, we employ a pretrained vision-language model (VLM) to generate descriptions for the composite image.

Image Harmonization Language Modeling +2

Robust Roadside Perception: an Automated Data Synthesis Pipeline Minimizing Human Annotation

no code implementations29 Jun 2023 Rusheng Zhang, Depu Meng, Lance Bassett, Shengyin Shen, Zhengxia Zou, Henry X. Liu

Our approach was rigorously tested at two key intersections in Michigan, USA: the Mcity intersection and the State St./Ellsworth Rd roundabout.

Autonomous Driving Generative Adversarial Network

RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Model

1 code implementation28 Jun 2023 Keyan Chen, Chenyang Liu, Hao Chen, Haotian Zhang, Wenyuan Li, Zhengxia Zou, Zhenwei Shi

We also propose several ongoing derivatives for instance segmentation tasks, drawing on recent advancements within the SAM community, and compare their performance with RSPrompter.

Image Segmentation Instance Segmentation +2

Continuous Cross-resolution Remote Sensing Image Change Detection

1 code implementation24 May 2023 Hao Chen, Haotian Zhang, Keyan Chen, Chenyao Zhou, Song Chen, Zhengxia Zou, Zhenwei Shi

Toward continuous cross-resolution CD, we propose scale-invariant learning to enforce the model consistently predicting HR results given synthesized samples of varying resolution differences.

Change Detection

Implicit Ray-Transformers for Multi-view Remote Sensing Image Segmentation

no code implementations15 Mar 2023 Zipeng Qi, Hao Chen, Chenyang Liu, Zhenwei Shi, Zhengxia Zou

In the first stage, we optimize a neural field to encode the color and 3D structure of the remote sensing scene based on multi-view images.

Image Segmentation Scene Segmentation +1

Dense Pixel-to-Pixel Harmonization via Continuous Image Representation

1 code implementation3 Mar 2023 Jianqi Chen, Yilan Zhang, Zhengxia Zou, Keyan Chen, Zhenwei Shi

High-resolution (HR) image harmonization is of great significance in real-world applications such as image synthesis and image editing.

Image Harmonization

Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creation

no code implementations CVPR 2023 Rui Zhao, Wei Li, Zhipeng Hu, Lincheng Li, Zhengxia Zou, Zhenwei Shi, Changjie Fan

In our method, taking the power of large-scale pre-trained multi-modal CLIP and neural rendering, T2P searches both continuous facial parameters and discrete facial parameters in a unified framework.

3D Generation Face Model +3

Progressive Scale-aware Network for Remote sensing Image Change Captioning

1 code implementation1 Mar 2023 Chenyang Liu, Jiajun Yang, Zipeng Qi, Zhengxia Zou, Zhenwei Shi

To sufficiently utilize the extracted multi-scale features for captioning, we propose a scale-aware reinforcement (SR) module and combine it with the Transformer decoding layer to progressively utilize the features from different PDP layers.

Continuous Remote Sensing Image Super-Resolution based on Context Interaction in Implicit Function Space

1 code implementation16 Feb 2023 Keyan Chen, Wenyuan Li, Sen Lei, Jianqi Chen, XiaoLong Jiang, Zhengxia Zou, Zhenwei Shi

Despite its fruitful applications in remote sensing, image super-resolution is troublesome to train and deploy as it handles different resolution magnifications with separate models.

Image Super-Resolution

Towards Unbiased Volume Rendering of Neural Implicit Surfaces With Geometry Priors

no code implementations CVPR 2023 Yongqiang Zhang, Zhipeng Hu, Haoqian Wu, Minda Zhao, Lincheng Li, Zhengxia Zou, Changjie Fan

In this paper, we argue that this limited accuracy is due to the bias of their volume rendering strategies, especially when the viewing direction is close to be tangent to the surface.

Surface Reconstruction

Remote Sensing Novel View Synthesis with Implicit Multiplane Representations

1 code implementation18 May 2022 Yongchang Wu, Zhengxia Zou, Zhenwei Shi

In this paper, we propose a novel remote sensing view synthesis method by leveraging the recent advances in implicit neural representations.

Novel View Synthesis

Multi-view 3D Reconstruction with Transformer

no code implementations24 Mar 2021 Dan Wang, Xinrui Cui, Xun Chen, Zhengxia Zou, Tianyang Shi, Septimiu Salcudean, Z. Jane Wang, Rabab Ward

Unlike previous CNN-based methods using a separate design, we unify the feature extraction and view fusion in a single Transformer network.

3D Object Reconstruction 3D Reconstruction +1

Single-Shot Motion Completion with Transformer

1 code implementation1 Mar 2021 Yinglin Duan, Tianyang Shi, Zhengxia Zou, Yenan Lin, Zhehui Qian, Bohan Zhang, Yi Yuan

Motion completion is a challenging and long-discussed problem, which is of great significance in film and game applications.

Motion Synthesis

MeInGame: Create a Game Character Face from a Single Portrait

1 code implementation4 Feb 2021 Jiangke Lin, Yi Yuan, Zhengxia Zou

To tackle these problems, we propose 1) a low-cost facial texture acquisition method, 2) a shape transfer algorithm that can transform the shape of a 3DMM mesh to games, and 3) a new pipeline for training 3D game face reconstruction networks.

3D Face Reconstruction Face Model

Multi-View 3D Reconstruction With Transformers

no code implementations ICCV 2021 Dan Wang, Xinrui Cui, Xun Chen, Zhengxia Zou, Tianyang Shi, Septimiu Salcudean, Z. Jane Wang, Rabab Ward

Unlike previous CNN-based methods using a separate design, we unify the feature extraction and view fusion in a single Transformer network.

3D Object Reconstruction 3D Reconstruction +1

NeuralMagicEye: Learning to See and Understand the Scene Behind an Autostereogram

1 code implementation31 Dec 2020 Zhengxia Zou, Tianyang Shi, Yi Yuan, Zhenwei Shi

This paper studies an interesting question that whether a deep CNN can be trained to recover the depth behind an autostereogram and understand its content.

Stylized Neural Painting

4 code implementations CVPR 2021 Zhengxia Zou, Tianyang Shi, Shuang Qiu, Yi Yuan, Zhenwei Shi

Different from previous image-to-image translation methods that formulate the translation as pixel-wise prediction, we deal with such an artistic creation process in a vectorized environment and produce a sequence of physically meaningful stroke parameters that can be further used for rendering.

Disentanglement Image-to-Image Translation +2

Castle in the Sky: Dynamic Sky Replacement and Harmonization in Videos

4 code implementations22 Oct 2020 Zhengxia Zou

This paper proposes a vision-based method for video sky replacement and harmonization, which can automatically generate realistic and dramatic sky backgrounds in videos with controllable styles.

Image Matting Motion Estimation

Neutral Face Game Character Auto-Creation via PokerFace-GAN

1 code implementation17 Aug 2020 Tianyang Shi, Zhengxia Zou, Xinhui Song, Zheng Song, Changjian Gu, Changjie Fan, Yi Yuan

Besides, the neural network based renderer used in previous methods is also difficult to be extended to multi-view rendering cases.

Self-Supervised Learning

Fast and Robust Face-to-Parameter Translation for Game Character Auto-Creation

no code implementations17 Aug 2020 Tianyang Shi, Zhengxia Zou, Yi Yuan, Changjie Fan

With the rapid development of Role-Playing Games (RPGs), players are now allowed to edit the facial appearance of their in-game characters with their preferences rather than using default templates.

3D Face Reconstruction Face Verification +3

Deep Adversarial Decomposition: A Unified Framework for Separating Superimposed Images

no code implementations CVPR 2020 Zhengxia Zou, Sen Lei, Tianyang Shi, Zhenwei Shi, Jieping Ye

Considering the layer separating ambiguity that given a single mixed input, there could be an infinite number of possible solutions, we introduce a "Separation-Critic" - a discriminative network which is trained to identify whether the output layers are well-separated and thus further improves the layer separation.

Image Shadow Removal Rain Removal +2

Multi-grained Attention Networks for Single Image Super-Resolution

no code implementations26 Sep 2019 Huapeng Wu, Zhengxia Zou, Jie Gui, Wen-Jun Zeng, Jieping Ye, Jun Zhang, Hongyi Liu, Zhihui Wei

In this paper, we make a thorough investigation on the attention mechanisms in a SR model and shed light on how simple and effective improvements on these ideas improve the state-of-the-arts.

Feature Importance Image Super-Resolution

Face-to-Parameter Translation for Game Character Auto-Creation

no code implementations ICCV 2019 Tianyang Shi, Yi Yuan, Changjie Fan, Zhengxia Zou, Zhenwei Shi, Yong liu

Character customization system is an important component in Role-Playing Games (RPGs), where players are allowed to edit the facial appearance of their in-game characters with their own preferences rather than using default templates.

Style Transfer Translation

Object Detection in 20 Years: A Survey

1 code implementation13 May 2019 Zhengxia Zou, Keyan Chen, Zhenwei Shi, Yuhong Guo, Jieping Ye

Object detection, as of one the most fundamental and challenging problems in computer vision, has received great attention in recent years.

Face Detection Object +4

Cannot find the paper you are looking for? You can Submit a new open access paper.