Search Results for author: Xu Jia

Found 46 papers, 28 papers with code

More Classifiers, Less Forgetting: A Generic Multi-classifier Paradigm for Incremental Learning

1 code implementation ECCV 2020 Yu Liu, Sarah Parisot, Gregory Slabaugh, Xu Jia, Ales Leonardis, Tinne Tuytelaars

Since those regularization strategies are mostly associated with classifier outputs, we propose a MUlti-Classifier (MUC) incremental learning paradigm that integrates an ensemble of auxiliary classifiers to estimate more effective regularization constraints.

Incremental Learning

CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models

1 code implementation24 Apr 2024 Qinghe Wang, Baolu Li, Xiaomin Li, Bing Cao, Liqian Ma, Huchuan Lu, Xu Jia

In this work, we propose CharacterFactory, a framework that allows sampling new characters with consistent identities in the latent space of GANs for diffusion models.

Consistent Character Generation Word Embeddings

Automated Evaluation of Large Vision-Language Models on Self-driving Corner Cases

no code implementations16 Apr 2024 Yanze Li, Wenhua Zhang, Kai Chen, Yanxin Liu, Pengxiang Li, Ruiyuan Gao, Lanqing Hong, Meng Tian, Xinhai Zhao, Zhenguo Li, Dit-yan Yeung, Huchuan Lu, Xu Jia

Large Vision-Language Models (LVLMs), due to the remarkable visual reasoning ability to understand images and videos, have received widespread attention in the autonomous driving domain, which significantly advances the development of interpretable end-to-end autonomous driving.

Autonomous Driving Visual Reasoning

StableIdentity: Inserting Anybody into Anywhere at First Sight

1 code implementation29 Jan 2024 Qinghe Wang, Xu Jia, Xiaomin Li, Taiqing Li, Liqian Ma, Yunzhi Zhuge, Huchuan Lu

We believe that the proposed StableIdentity is an important step to unify image, video, and 3D customized generation models.

3D Generation

TrackDiffusion: Tracklet-Conditioned Video Generation via Diffusion Models

no code implementations1 Dec 2023 Pengxiang Li, Kai Chen, Zhili Liu, Ruiyuan Gao, Lanqing Hong, Guo Zhou, Hua Yao, Dit-yan Yeung, Huchuan Lu, Xu Jia

Despite remarkable achievements in video synthesis, achieving granular control over complex dynamics, such as nuanced movement among multiple interacting objects, still presents a significant hurdle for dynamic world modeling, compounded by the necessity to manage appearance and disappearance, drastic scale changes, and ensure consistency for instances across frames.

Image Classification Multi-Object Tracking +4

GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Models

1 code implementation11 Oct 2023 Ruotong Liao, Xu Jia, Yangzhe Li, Yunpu Ma, Volker Tresp

Extensive experiments have shown that GenTKG outperforms conventional methods of temporal relational forecasting with low computation resources using extremely limited training data as few as 16 samples.


UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory

1 code implementation28 Aug 2023 Haiwen Diao, Bo Wan, Ying Zhang, Xu Jia, Huchuan Lu, Long Chen

Parameter-efficient transfer learning (PETL), i. e., fine-tuning a small portion of parameters, is an effective strategy for adapting pre-trained models to downstream domains.

Question Answering Retrieval +5

Neural Image Re-Exposure

1 code implementation23 May 2023 Xinyu Zhang, Hefei Huang, Xu Jia, Dong Wang, Huchuan Lu

In this work, we aim to re-expose the captured photo in post-processing to provide a more flexible way of addressing those issues within a unified framework.

Ranked #4 on Deblurring on GoPro (using extra training data)

Deblurring Decoder +6

Pre-trained Language Model with Prompts for Temporal Knowledge Graph Completion

1 code implementation13 May 2023 Wenjie Xu, Ben Liu, Miao Peng, Xu Jia, Min Peng

We train our model with a masking strategy to convert TKGC task into a masked token prediction task, which can leverage the semantic information in pre-trained language models.

Language Modelling Temporal Knowledge Graph Completion

GM-NeRF: Learning Generalizable Model-based Neural Radiance Fields from Multi-view Images

no code implementations CVPR 2023 Jianchuan Chen, Wentao Yi, Liqian Ma, Xu Jia, Huchuan Lu

The results demonstrate that our approach outperforms state-of-the-art methods in terms of novel view synthesis and geometric reconstruction.

Neural Rendering Novel View Synthesis

Dual Memory Aggregation Network for Event-Based Object Detection with Learnable Representation

1 code implementation17 Mar 2023 Dongsheng Wang, Xu Jia, Yang Zhang, Xinyu Zhang, Yaoyuan Wang, Ziyang Zhang, Dong Wang, Huchuan Lu

To fully exploit information with event streams to detect objects, a dual-memory aggregation network (DMANet) is proposed to leverage both long and short memory along event streams to aggregate effective information for object detection.

Object object-detection +1

Compression-Aware Video Super-Resolution

1 code implementation CVPR 2023 Yingwei Wang, Xu Jia, Xin Tao, Takashi Isobe, Huchuan Lu, Yu-Wing Tai

Videos stored on mobile devices or delivered on the Internet are usually in compressed format and are of various unknown compression parameters, but most video super-resolution (VSR) methods often assume ideal inputs resulting in large performance gap between experimental settings and real-world applications.

Model Compression Video Enhancement +1

AdaInt: Learning Adaptive Intervals for 3D Lookup Tables on Real-time Image Enhancement

1 code implementation CVPR 2022 Canqian Yang, Meiguang Jin, Xu Jia, Yi Xu, Ying Chen

They adopt a sub-optimal uniform sampling point allocation, limiting the expressiveness of the learned LUTs since the (tri-)linear interpolation between uniform sampling points in the LUT transform might fail to model local non-linearities of the color transform.

Image Enhancement Photo Retouching

Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modeling

1 code implementation CVPR 2022 Takashi Isobe, Xu Jia, Xin Tao, Changlin Li, Ruihuang Li, Yongjie Shi, Jing Mu, Huchuan Lu, Yu-Wing Tai

Instead of directly feeding consecutive frames into a VSR model, we propose to compute the temporal difference between frames and divide those pixels into two subsets according to the level of difference.

Motion Compensation Optical Flow Estimation +1

FoV-Net: Field-of-View Extrapolation Using Self-Attention and Uncertainty

no code implementations4 Apr 2022 Liqian Ma, Stamatios Georgoulis, Xu Jia, Luc van Gool

The ability to make educated predictions about their surroundings, and associate them with certain confidence, is important for intelligent systems, like autonomous vehicles and robots.

Autonomous Vehicles Decision Making

Transformer-based Network for RGB-D Saliency Detection

no code implementations1 Dec 2021 Yue Wang, Xu Jia, Lu Zhang, Yuke Li, James Elder, Huchuan Lu

TFFM conducts a sufficient feature fusion by integrating features from multiple scales and two modalities over all positions simultaneously.

Saliency Detection

Motion Deblurring with Real Events

no code implementations ICCV 2021 Fang Xu, Lei Yu, Bishan Wang, Wen Yang, Gui-Song Xia, Xu Jia, Zhendong Qiao, Jianzhuang Liu

In this paper, we propose an end-to-end learning framework for event-based motion deblurring in a self-supervised manner, where real-world events are exploited to alleviate the performance degradation caused by data inconsistency.


Wavelet-Based Network For High Dynamic Range Imaging

1 code implementation3 Aug 2021 Tianhong Dai, Wei Li, Xilei Cao, Jianzhuang Liu, Xu Jia, Ales Leonardis, Youliang Yan, Shanxin Yuan

The frequency-guided upsampling module reconstructs details from multiple frequency-specific components with rich details.

Optical Flow Estimation Vocal Bursts Intensity Prediction

T-SVDNet: Exploring High-Order Prototypical Correlations for Multi-Source Domain Adaptation

1 code implementation ICCV 2021 Ruihuang Li, Xu Jia, Jianzhong He, Shuaijun Chen, QinGhua Hu

Most existing domain adaptation methods focus on adaptation from only one source domain, however, in practice there are a number of relevant sources that could be leveraged to help improve performance on target domain.

Unsupervised Domain Adaptation

Animatable Neural Radiance Fields from Monocular RGB Videos

1 code implementation25 Jun 2021 Jianchuan Chen, Ying Zhang, Di Kang, Xuefei Zhe, Linchao Bao, Xu Jia, Huchuan Lu

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos.

3D Human Reconstruction Neural Rendering +2

Multi-Target Domain Adaptation with Collaborative Consistency Learning

no code implementations CVPR 2021 Takashi Isobe, Xu Jia, Shuaijun Chen, Jianzhong He, Yongjie Shi, Jianzhuang Liu, Huchuan Lu, Shengjin Wang

To obtain a single model that works across multiple target domains, we propose to simultaneously learn a student model which is trained to not only imitate the output of each expert on the corresponding target domain, but also to pull different expert close to each other with regularization on their weights.

Multi-target Domain Adaptation Semantic Segmentation +1

Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images

12 code implementations CVPR 2021 Tao Huang, Songjiang Li, Xu Jia, Huchuan Lu, Jianzhuang Liu

In this paper, we present a very simple yet effective method named Neighbor2Neighbor to train an effective image denoising model with only noisy images.

Image Denoising Self-Supervised Learning

Revisiting Temporal Modeling for Video Super-resolution

2 code implementations13 Aug 2020 Takashi Isobe, Fang Zhu, Xu Jia, Shengjin Wang

Video super-resolution plays an important role in surveillance video analysis and ultra-high-definition video display, which has drawn much attention in both the research and industrial communities.

Computational Efficiency Video Super-Resolution

Unsupervised Model Personalization while Preserving Privacy and Scalability: An Open Problem

1 code implementation CVPR 2020 Matthias De Lange, Xu Jia, Sarah Parisot, Ales Leonardis, Gregory Slabaugh, Tinne Tuytelaars

This framework flexibly disentangles user-adaptation into model personalization on the server and local data regularization on the user device, with desirable properties regarding scalability and privacy constraints.

Continual Learning Domain Adaptation +2

MMD GAN with Random-Forest Kernels

no code implementations ICLR 2020 Tao Huang, Zhen Han, Xu Jia, Hanyuan Hang

In this paper, we propose a novel kind of kernel, random forest kernel, to enhance the empirical performance of MMD GAN.

Ensemble Learning

Unsupervised Image Super-Resolution with an Indirect Supervised Path

no code implementations7 Oct 2019 Zhen Han, Enyan Dai, Xu Jia, Xiaoying Ren, Shuaijun Chen, Chunjing Xu, Jianzhuang Liu, Qi Tian

The task of single image super-resolution (SISR) aims at reconstructing a high-resolution (HR) image from a low-resolution (LR) image.

Image Super-Resolution Translation

Efficient Residual Dense Block Search for Image Super-Resolution

3 code implementations25 Sep 2019 Dehua Song, Chang Xu, Xu Jia, Yiyi Chen, Chunjing Xu, Yunhe Wang

Focusing on this issue, we propose an efficient residual dense block search algorithm with multiple objectives to hunt for fast, lightweight and accurate networks for image super-resolution.

Image Super-Resolution

A continual learning survey: Defying forgetting in classification tasks

1 code implementation18 Sep 2019 Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Ales Leonardis, Gregory Slabaugh, Tinne Tuytelaars

Artificial neural networks thrive in solving the classification problem for a particular rigid task, acquiring knowledge through generalized learning behaviour from a distinct training phase.

Classification Continual Learning +2

Co-Evolutionary Compression for Unpaired Image Translation

2 code implementations ICCV 2019 Han Shu, Yunhe Wang, Xu Jia, Kai Han, Hanting Chen, Chunjing Xu, Qi Tian, Chang Xu

Generative adversarial networks (GANs) have been successfully used for considerable computer vision tasks, especially the image-to-image translation.

Image-to-Image Translation Translation

Video Generation from Single Semantic Label Map

2 code implementations CVPR 2019 Junting Pan, Chengyu Wang, Xu Jia, Jing Shao, Lu Sheng, Junjie Yan, Xiaogang Wang

This paper proposes the novel task of video generation conditioned on a SINGLE semantic label map, which provides a good balance between flexibility and quality in the generation process.

Image Generation Image to Video Generation +1

Exemplar Guided Unsupervised Image-to-Image Translation with Semantic Consistency

no code implementations ICLR 2019 Liqian Ma, Xu Jia, Stamatios Georgoulis, Tinne Tuytelaars, Luc van Gool

Experimental results on various datasets show that EGSC-IT does not only translate the source image to diverse instances in the target domain, but also preserves the semantic consistency during the process.

Translation Unsupervised Image-To-Image Translation

Super-Resolution with Deep Adaptive Image Resampling

no code implementations18 Dec 2017 Xu Jia, Hong Chang, Tinne Tuytelaars

In this work, we revisit the more traditional interpolation-based methods, that were popular before, now with the help of deep learning.

Image Super-Resolution

Pose Guided Person Image Generation

2 code implementations NeurIPS 2017 Liqian Ma, Xu Jia, Qianru Sun, Bernt Schiele, Tinne Tuytelaars, Luc van Gool

This paper proposes the novel Pose Guided Person Generation Network (PG$^2$) that allows to synthesize person images in arbitrary poses, based on an image of that person and a novel pose.

Gesture-to-Gesture Translation Pose Transfer

Dynamic Filter Networks

1 code implementation NeurIPS 2016 Bert De Brabandere, Xu Jia, Tinne Tuytelaars, Luc van Gool

In a traditional convolutional layer, the learned filters stay fixed after training.

 Ranked #1 on Video Prediction on KTH (Cond metric)

Depth Estimation Optical Flow Estimation +1

Towards Automatic Image Editing: Learning to See another You

no code implementations26 Nov 2015 Amir Ghodrati, Xu Jia, Marco Pedersoli, Tinne Tuytelaars

Learning the distribution of images in order to generate new samples is a challenging task due to the high dimensionality of the data and the highly non-linear relations that are involved.

Attribute Image Generation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.