Search Results for author: Junni Zou

Found 27 papers, 7 papers with code

Improving Diffusion Models for Inverse Problems Using Optimal Posterior Covariance

1 code implementation3 Feb 2024 Xinyu Peng, Ziyang Zheng, Wenrui Dai, Nuoqian Xiao, Chenglin Li, Junni Zou, Hongkai Xiong

In this paper, we propose the first unified interpretation for existing zero-shot methods from the perspective of approximating the conditional posterior mean for the reverse diffusion process of conditional sampling.

UMG-CLIP: A Unified Multi-Granularity Vision Generalist for Open-World Understanding

no code implementations12 Jan 2024 Bowen Shi, Peisen Zhao, Zichen Wang, Yuhang Zhang, Yaoming Wang, Jin Li, Wenrui Dai, Junni Zou, Hongkai Xiong, Qi Tian, Xiaopeng Zhang

Vision-language foundation models, represented by Contrastive language-image pre-training (CLIP), have gained increasing attention for jointly understanding both vision and textual tasks.

Panoptic Segmentation Retrieval +1

scBiGNN: Bilevel Graph Representation Learning for Cell Type Classification from Single-cell RNA Sequencing Data

no code implementations16 Dec 2023 Rui Yang, Wenrui Dai, Chenglin Li, Junni Zou, Dapeng Wu, Hongkai Xiong

A gene-level GNN is established to adaptively learn gene-gene interactions and cell representations via the self-attention mechanism, and a cell-level GNN builds on the cell-cell graph that is constructed from the cell representations generated by the gene-level GNN.

Classification Graph Representation Learning

Frequency-Aware Transformer for Learned Image Compression

1 code implementation25 Oct 2023 Han Li, Shaohui Li, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

Learned image compression (LIC) has gained traction as an effective solution for image storage and transmission in recent years.

Image Compression

Hybrid Distillation: Connecting Masked Autoencoders with Contrastive Learners

no code implementations28 Jun 2023 Bowen Shi, Xiaopeng Zhang, Yaoming Wang, Jin Li, Wenrui Dai, Junni Zou, Hongkai Xiong, Qi Tian

In order to better obtain both discrimination and diversity, we propose a simple but effective Hybrid Distillation strategy, which utilizes both the supervised/CL teacher and the MIM teacher to jointly guide the student model.

Contrastive Learning Representation Learning

Learned Lossless Compression for JPEG via Frequency-Domain Prediction

no code implementations5 Mar 2023 Jixiang Luo, Shaohui Li, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

In this paper, we propose a novel framework for learned lossless compression of JPEG images that achieves end-to-end optimized prediction of the distribution of decoded DCT coefficients.

Pose-Oriented Transformer with Uncertainty-Guided Refinement for 2D-to-3D Human Pose Estimation

no code implementations15 Feb 2023 Han Li, Bowen Shi, Wenrui Dai, Hongwei Zheng, Botao Wang, Yu Sun, Min Guo, Chenlin Li, Junni Zou, Hongkai Xiong

There has been a recent surge of interest in introducing transformers to 3D human pose estimation (HPE) due to their powerful capabilities in modeling long-term dependencies.

3D Human Pose Estimation Position

Optimization-based Block Coordinate Gradient Coding for Mitigating Partial Stragglers in Distributed Learning

no code implementations6 Jun 2022 Qi Wang, Ying Cui, Chenglin Li, Junni Zou, Hongkai Xiong

To reduce computational complexity, we first transform each to an equivalent but much simpler discrete problem with N\llL variables representing the partition of the L coordinates into N blocks, each with identical redundancy.

Hierarchical Spherical CNNs with Lifting-based Adaptive Wavelets for Pooling and Unpooling

no code implementations31 May 2022 Mingxing Xu, Chenglin Li, Wenrui Dai, Siheng Chen, Junni Zou, Pascal Frossard, Hongkai Xiong

Specifically, adaptive spherical wavelets are learned with a lifting structure that consists of trainable lifting operators (i. e., update and predict operators).

LiftPool: Lifting-based Graph Pooling for Hierarchical Graph Representation Learning

no code implementations27 Apr 2022 Mingxing Xu, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

Subsequently, this local information is aligned and propagated to the preserved nodes to alleviate information loss in graph coarsening.

Graph Classification Graph Representation Learning

Hybrid ISTA: Unfolding ISTA With Convergence Guarantees Using Free-Form Deep Neural Networks

1 code implementation25 Apr 2022 Ziyang Zheng, Wenrui Dai, Duoduo Xue, Chenglin Li, Junni Zou, Hongkai Xiong

This framework is general to endow arbitrary DNNs for solving linear inverse problems with convergence guarantees.

Compressive Sensing

Hierarchical Graph Networks for 3D Human Pose Estimation

1 code implementation23 Nov 2021 Han Li, Bowen Shi, Wenrui Dai, Yabo Chen, Botao Wang, Yu Sun, Min Guo, Chenlin Li, Junni Zou, Hongkai Xiong

Recent 2D-to-3D human pose estimation works tend to utilize the graph structure formed by the topology of the human skeleton.

3D Human Pose Estimation

Variance Reduced Domain Randomization for Policy Gradient

no code implementations29 Sep 2021 Yuankun Jiang, Chenglin Li, Wenrui Dai, Junni Zou, Hongkai Xiong

In this paper, we theoretically derive a bias-free and state/environment-dependent optimal baseline for DR, and analytically show its ability to achieve further variance reduction over the standard constant and state-dependent baselines for DR. We further propose a variance reduced domain randomization (VRDR) approach for policy gradient methods, to strike a tradeoff between the variance reduction and computational complexity in practice.

Policy Gradient Methods

Graph Convolutional Networks via Adaptive Filter Banks

no code implementations29 Sep 2021 Xing Gao, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong, Pascal Frossard

Graph convolutional networks have been a powerful tool in representation learning of networked data.

Representation Learning

Graph Neural Networks With Lifting-based Adaptive Graph Wavelets

no code implementations3 Aug 2021 Mingxing Xu, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong, Pascal Frossard

To ensure that the learned graph representations are invariant to node permutations, a layer is employed at the input of the networks to reorder the nodes according to their local topology information.

Graph Representation Learning

Message Passing in Graph Convolution Networks via Adaptive Filter Banks

no code implementations18 Jun 2021 Xing Gao, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong, Pascal Frossard

Furthermore, each filter in the spectral domain corresponds to a message passing scheme, and diverse schemes are implemented via the filter bank.

Graph Classification Representation Learning

Multi-dataset Pretraining: A Unified Model for Semantic Segmentation

no code implementations8 Jun 2021 Bowen Shi, Xiaopeng Zhang, Haohang Xu, Wenrui Dai, Junni Zou, Hongkai Xiong, Qi Tian

This is achieved by first pretraining the network via the proposed pixel-to-prototype contrastive loss over multiple datasets regardless of their taxonomy labels, and followed by fine-tuning the pretrained model over specific dataset as usual.

Semantic Segmentation

Monotonic Robust Policy Optimization with Model Discrepancy

no code implementations1 Jan 2021 Yuankun Jiang, Chenglin Li, Junni Zou, Wenrui Dai, Hongkai Xiong

To mitigate the model discrepancy between training and target (testing) environments, domain randomization (DR) can generate plenty of environments with a sufficient diversity by randomly sampling environment parameters in simulator.

Learning Latent Architectural Distribution in Differentiable Neural Architecture Search via Variational Information Maximization

no code implementations ICCV 2021 Yaoming Wang, Yuchen Liu, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

Existing differentiable neural architecture search approaches simply assume the architectural distribution on each edge is independent of each other, which conflicts with the intrinsic properties of architecture.

Neural Architecture Search

VEM-GCN: Topology Optimization with Variational EM for Graph Convolutional Networks

no code implementations1 Jan 2021 Rui Yang, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

In the variational E-step, graph topology is optimized by approximating the posterior probability distribution of the latent adjacency matrix with a neural network learned from node embeddings.

Classification General Classification +2

PAC-Bayesian Randomized Value Function with Informative Prior

no code implementations1 Jan 2021 Yuankun Jiang, Chenglin Li, Junni Zou, Wenrui Dai, Hongkai Xiong

To address this, in this paper, we propose a Bayesian linear regression with informative prior (IP-BLR) operator to leverage the data-dependent prior in the learning process of randomized value function, which can leverage the statistics of training results from previous iterations.

Reinforcement Learning (RL)

NCGNN: Node-Level Capsule Graph Neural Network for Semisupervised Classification

no code implementations7 Dec 2020 Rui Yang, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

Therefore, it can relieve the over-smoothing issue and learn effective node representations over graphs with homophily or heterophily.

Classification Node Classification

MimicNorm: Weight Mean and Last BN Layer Mimic the Dynamic of Batch Normalization

1 code implementation19 Oct 2020 Wen Fei, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

We leverage the neural tangent kernel (NTK) theory to prove that our weight mean operation whitens activations and transits network into the chaotic regime like BN layer, and consequently, leads to an enhanced convergence.

AP-Loss for Accurate One-Stage Object Detection

1 code implementation17 Aug 2020 Kean Chen, Weiyao Lin, Jianguo Li, John See, Ji Wang, Junni Zou

This paper alleviates this issue by proposing a novel framework to replace the classification task in one-stage detectors with a ranking task, and adopting the Average-Precision loss (AP-loss) for the ranking problem.

Classification General Classification +3

Group Re-Identification with Multi-grained Matching and Integration

no code implementations17 May 2019 Weiyao Lin, Yuxi Li, Hao Xiao, John See, Junni Zou, Hongkai Xiong, Jingdong Wang, Tao Mei

The task of re-identifying groups of people underdifferent camera views is an important yet less-studied problem. Group re-identification (Re-ID) is a very challenging task sinceit is not only adversely affected by common issues in traditionalsingle object Re-ID problems such as viewpoint and human posevariations, but it also suffers from changes in group layout andgroup membership.

Towards Accurate One-Stage Object Detection with AP-Loss

1 code implementation CVPR 2019 Kean Chen, Jianguo Li, Weiyao Lin, John See, Ji Wang, Ling-Yu Duan, Zhibo Chen, Changwei He, Junni Zou

For this purpose, we develop a novel optimization algorithm, which seamlessly combines the error-driven update scheme in perceptron learning and backpropagation algorithm in deep networks.

Classification General Classification +3

Cannot find the paper you are looking for? You can Submit a new open access paper.