Search Results for author: Bin Zhao

Found 38 papers, 11 papers with code

Disentangled Contrastive Image Translation for Nighttime Surveillance

no code implementations11 Jul 2023 Guanzhou Lan, Bin Zhao, Xuelong Li

Targeting the surveillance scenes, we develop a disentangled representation, which is an auxiliary pretext task that separates surveillance scenes into the foreground and background with contrastive learning.

Contrastive Learning Translation

Diffusion Model is an Effective Planner and Data Synthesizer for Multi-Task Reinforcement Learning

1 code implementation29 May 2023 Haoran He, Chenjia Bai, Kang Xu, Zhuoran Yang, Weinan Zhang, Dong Wang, Bin Zhao, Xuelong Li

Specifically, we propose Multi-Task Diffusion Model (\textsc{MTDiff}), a diffusion-based method that incorporates Transformer backbones and prompt learning for generative planning and data synthesis in multi-task offline settings.

Reinforcement Learning (RL)

On the Value of Myopic Behavior in Policy Reuse

no code implementations28 May 2023 Kang Xu, Chenjia Bai, Shuang Qiu, Haoran He, Bin Zhao, Zhen Wang, Wei Li, Xuelong Li

Leveraging learned strategies in unfamiliar scenarios is fundamental to human intelligence.

Cross-Domain Policy Adaptation via Value-Guided Data Filtering

no code implementations28 May 2023 Kang Xu, Chenjia Bai, Xiaoteng Ma, Dong Wang, Bin Zhao, Zhen Wang, Xuelong Li, Wei Li

Specifically, we present the Value-Guided Data Filtering (VGDF) algorithm, which selectively shares transitions from the source domain based on the proximity of paired value targets across the two domains.

Behavior Contrastive Learning for Unsupervised Skill Discovery

1 code implementation8 May 2023 Rushuai Yang, Chenjia Bai, Hongyi Guo, Siyuan Li, Bin Zhao, Zhen Wang, Peng Liu, Xuelong Li

Under mild assumptions, our objective maximizes the MI between different behaviors based on the same skill, which serves as an upper bound of the previous MI objective.

Continuous Control Contrastive Learning

Not All Features Matter: Enhancing Few-shot CLIP with Adaptive Prior Refinement

1 code implementation ICCV 2023 Xiangyang Zhu, Renrui Zhang, Bowei He, Aojun Zhou, Dong Wang, Bin Zhao, Peng Gao

The popularity of Contrastive Language-Image Pre-training (CLIP) has propelled its application to diverse downstream vision tasks.

Few-Shot Learning

Towards Nonlinear-Motion-Aware and Occlusion-Robust Rolling Shutter Correction

1 code implementation ICCV 2023 Delin Qu, Yizhen Lao, Zhigang Wang, Dong Wang, Bin Zhao, Xuelong Li

This paper addresses the problem of rolling shutter correction in complex nonlinear and dynamic scenes with extreme occlusion.

Rolling Shutter Correction

ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidance

1 code implementation29 Mar 2023 Zoey Guo, Yiwen Tang, Ray Zhang, Dong Wang, Zhigang Wang, Bin Zhao, Xuelong Li

In this paper, we propose ViewRefer, a multi-view framework for 3D visual grounding exploring how to grasp the view knowledge from both text and 3D modalities.

Visual Grounding

Propagate And Calibrate: Real-time Passive Non-line-of-sight Tracking

no code implementations CVPR 2023 Yihao Wang, Zhigang Wang, Bin Zhao, Dong Wang, Mulin Chen, Xuelong Li

In contrast, we propose a purely passive method to track a person walking in an invisible room by only observing a relay wall, which is more in line with real application scenarios, e. g., security.

Fully Self-Supervised Depth Estimation from Defocus Clue

1 code implementation CVPR 2023 Haozhe Si, Bin Zhao, Dong Wang, Yunpeng Gao, Mulin Chen, Zhigang Wang, Xuelong Li

We show that our framework circumvents the needs for the depth and AIF image ground-truth, and receives superior predictions, thus closing the gap between the theoretical success of DFD works and their applications in the real world.

Depth Estimation

ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding

no code implementations ICCV 2023 Zoey Guo, Yiwen Tang, Ray Zhang, Dong Wang, Zhigang Wang, Bin Zhao, Xuelong Li

In this paper, we propose ViewRefer, a multi-view framework for 3D visual grounding exploring how to grasp the view knowledge from both text and 3D modalities.

Visual Grounding

Low-Light Hyperspectral Image Enhancement

1 code implementation5 Aug 2022 Xuelong Li, Guanlin Li, Bin Zhao

The illumination enhancement branch is adopted to enlighten the low-frequency component with reduced resolution.

Image Enhancement

RCLane: Relay Chain Prediction for Lane Detection

no code implementations19 Jul 2022 Shenghua Xu, Xinyue Cai, Bin Zhao, Li Zhang, Hang Xu, Yanwei Fu, xiangyang xue

This is because most of the existing lane detection methods either treat the lane detection as a dense prediction or a detection task, few of them consider the unique topologies (Y-shape, Fork-shape, nearly horizontal lane) of the lane markers, which leads to sub-optimal solution.

Lane Detection

Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training

3 code implementations28 May 2022 Renrui Zhang, Ziyu Guo, Rongyao Fang, Bin Zhao, Dong Wang, Yu Qiao, Hongsheng Li, Peng Gao

By fine-tuning on downstream tasks, Point-M2AE achieves 86. 43% accuracy on ScanObjectNN, +3. 36% to the second-best, and largely benefits the few-shot classification, part segmentation and 3D object detection with the hierarchical pre-training scheme.

Ranked #3 on 3D Point Cloud Linear Classification on ModelNet40 (using extra training data)

3D Object Detection 3D Point Cloud Linear Classification +5

Community detection in censored hypergraph

no code implementations4 Nov 2021 Mingao Yuan, Bin Zhao, Xiaofeng Zhao

In practice, a network may has censored (or missing) values and it is shown that censored values have non-negligible effect on the structural properties of a network.

Community Detection

Hierarchical Multimodal Transformer to Summarize Videos

no code implementations22 Sep 2021 Bin Zhao, Maoguo Gong, Xuelong Li

To integrate the two kinds of information, they are encoded in a two-stream scheme, and a multimodal fusion mechanism is developed based on the hierarchical transformer.

Machine Translation Translation +2

Audio-Visual Collaborative Representation Learning for Dynamic Saliency Prediction

no code implementations17 Sep 2021 Hailong Ning, Bin Zhao, Zhanxuan Hu, Lang He, Ercheng Pei

Motivated by this, an audio-visual collaborative representation learning method is proposed for the DSP task, which explores the audio modality to better predict the dynamic saliency map by assisting vision modality.

Representation Learning Saliency Prediction +1

Video Crowd Localization with Multi-focus Gaussian Neighborhood Attention and a Large-Scale Benchmark

1 code implementation19 Jul 2021 Haopeng Li, Lingbo Liu, Kunlin Yang, Shinan Liu, Junyu Gao, Bin Zhao, Rui Zhang, Jun Hou

Video crowd localization is a crucial yet challenging task, which aims to estimate exact locations of human heads in the given crowded videos.

PSRR-MaxpoolNMS: Pyramid Shifted MaxpoolNMS with Relationship Recovery

no code implementations CVPR 2021 Tianyi Zhang, Jie Lin, Peng Hu, Bin Zhao, Mohamed M. Sabry Aly

Unlike convolutions which are inherently parallel, the de-facto standard for NMS, namely GreedyNMS, cannot be easily parallelized and thus could be the performance bottleneck in convolutional object detection pipelines.

object-detection Object Detection

AudioVisual Video Summarization

no code implementations17 May 2021 Bin Zhao, Maoguo Gong, Xuelong Li

Motivated by this, we propose to jointly exploit the audio and visual information for the video summarization task, and develop an AudioVisual Recurrent Network (AVRN) to achieve this.

Video Summarization

EA-Net: Edge-Aware Network for Flow-based Video Frame Interpolation

no code implementations17 May 2021 Bin Zhao, Xuelong Li

Specifically, in the flow estimation stage, three edge-aware mechanisms are developed to emphasize the frame edges in estimating flow maps, so that the edge-maps are taken as the auxiliary information to provide more guidance to boost the flow accuracy.

Video Frame Interpolation

Reconstructive Sequence-Graph Network for Video Summarization

no code implementations10 May 2021 Bin Zhao, Haopeng Li, Xiaoqiang Lu, Xuelong Li

Then, the videos are summarized by exploiting both the local and global dependencies among shots.

Video Summarization

Weather GAN: Multi-Domain Weather Translation Using Generative Adversarial Networks

no code implementations9 Mar 2021 Xuelong Li, Kai Kou, Bin Zhao

To this end, the generator of Weather GAN is composed of an initial translation module, an attention module and a weather-cue segmentation module.

Style Transfer Translation

Automated Segmentation of Brain Gray Matter Nuclei on Quantitative Susceptibility Mapping Using Deep Convolutional Neural Network

no code implementations3 Aug 2020 Chao Chai, Pengchong Qiao, Bin Zhao, Huiying Wang, Guohua Liu, Hong Wu, E Mark Haacke, Wen Shen, Chen Cao, Xinchen Ye, Zhiyang Liu, Shuang Xia

Abnormal iron accumulation in the brain subcortical nuclei has been reported to be correlated to various neurodegenerative diseases, which can be measured through the magnetic susceptibility from the quantitative susceptibility mapping (QSM).

Automatic acute ischemic stroke lesion segmentation using semi-supervised learning

no code implementations10 Aug 2019 Bin Zhao, Shuxue Ding, Hong Wu, Guohua Liu, Chen Cao, Song Jin, Zhiyang Liu

By using a large number of weakly labeled subjects and a small number of fully labeled subjects, our proposed method is able to accurately detect and segment the AIS lesions.

Clustering Ischemic Stroke Lesion Segmentation +1

Travel Time Estimation without Road Networks: An Urban Morphological Layout Representation Approach

no code implementations8 Jul 2019 Wuwei Lan, Yanyan Xu, Bin Zhao

Travel time estimation is a crucial task for not only personal travel scheduling but also city planning.


C^3 Framework: An Open-source PyTorch Code for Crowd Counting

3 code implementations5 Jul 2019 Junyu. Gao, Wei. Lin, Bin Zhao, Dong Wang, Chenyu Gao, Jun Wen

This technical report attempts to provide efficient and solid kits addressed on the field of crowd counting, which is denoted as Crowd Counting Code Framework (C$^3$F).

Crowd Counting

Hierarchical Recurrent Neural Network for Video Summarization

no code implementations28 Apr 2019 Bin Zhao, Xuelong. Li, Xiaoqiang Lu

Compared to traditional RNNs, H-RNN is more suitable to video summarization, since it can exploit long temporal dependency among frames, meanwhile, the computation operations are significantly lessened.

Video Captioning Video Summarization

A CNN-RNN Architecture for Multi-Label Weather Recognition

no code implementations24 Apr 2019 Bin Zhao, Xuelong. Li, Xiaoqiang Lu, Zhigang Wang

To address this problem, we make the first attempt to view weather recognition as a multi-label classification task, i. e., assigning an image more than one labels according to the displayed weather conditions.

General Classification Multi-Label Classification

A General Framework for Edited Video and Raw Video Summarization

no code implementations24 Apr 2019 Xuelong. Li, Bin Zhao, Xiaoqiang Lu

Besides, the property-weights are learned for edited videos and raw videos, respectively.

Video Summarization

Dataflow-based Joint Quantization of Weights and Activations for Deep Neural Networks

no code implementations4 Jan 2019 Xue Geng, Jie Fu, Bin Zhao, Jie Lin, Mohamed M. Sabry Aly, Christopher Pal, Vijay Chandrasekhar

This paper addresses a challenging problem - how to reduce energy consumption without incurring performance drop when deploying deep neural networks (DNNs) at the inference stage.


HSA-RNN: Hierarchical Structure-Adaptive RNN for Video Summarization

no code implementations CVPR 2018 Bin Zhao, Xuelong. Li, Xiaoqiang Lu

Although video summarization has achieved great success in recent years, few approaches have realized the influence of video structure on the summarization results.

Video Summarization

Hierarchical Feature Hashing for Fast Dimensionality Reduction

no code implementations CVPR 2014 Bin Zhao, Eric P. Xing

Curse of dimensionality is a practical and challenging problem in image categorization, especially in cases with a large number of classes.

Classification Dimensionality Reduction +5

Quasi Real-Time Summarization for Consumer Videos

no code implementations CVPR 2014 Bin Zhao, Eric P. Xing

With the widespread availability of video cameras, we are facing an ever-growing enormous collection of unedited and unstructured video data.

Sparse Output Coding for Large-Scale Visual Recognition

no code implementations CVPR 2013 Bin Zhao, Eric P. Xing

Many vision tasks require a multi-class classifier to discriminate multiple categories, on the order of hundreds or thousands.

Classification General Classification +3

Large-Scale Category Structure Aware Image Categorization

no code implementations NeurIPS 2011 Bin Zhao, Fei Li, Eric P. Xing

With the emergence of structured large-scale dataset such as the ImageNet, rich information about the conceptual relationships between images, such as a tree hierarchy among various image categories, become available.

Image Categorization

Cannot find the paper you are looking for? You can Submit a new open access paper.