Search Results for author: Jiaqi Wang

Found 50 papers, 28 papers with code

CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers

1 code implementation27 May 2023 Dachuan Shi, Chaofan Tao, Anyi Rao, Zhendong Yang, Chun Yuan, Jiaqi Wang

Specifically, the proposed \textit{CrossGET} has two key designs:1) \textit{Cross-Guided Matching and Ensemble}.

ImpressionGPT: An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT

1 code implementation17 Apr 2023 Chong Ma, Zihao Wu, Jiaqi Wang, Shaochen Xu, Yaonai Wei, Zhengliang Liu, Xi Jiang, Lei Guo, Xiaoyan Cai, Shu Zhang, Tuo Zhang, Dajiang Zhu, Dinggang Shen, Tianming Liu, Xiang Li

The 'Impression' section of a radiology report is a critical basis for communication between radiologists and other physicians, and it is typically written by radiologists based on the 'Findings' section.

V3Det: Vast Vocabulary Visual Detection Dataset

no code implementations7 Apr 2023 Jiaqi Wang, Pan Zhang, Tao Chu, Yuhang Cao, Yujie Zhou, Tong Wu, Bin Wang, Conghui He, Dahua Lin

To facilitate the development of more general visual object detection, we propose V3Det, a vast vocabulary visual detection dataset with precisely annotated bounding boxes on massive images.

Chatbot object-detection +1

Self-supervised Action Representation Learning from Partial Spatio-Temporal Skeleton Sequences

1 code implementation17 Feb 2023 Yujie Zhou, Haodong Duan, Anyi Rao, Bing Su, Jiaqi Wang

Specifically, we construct a negative-sample-free triplet steam structure that is composed of an anchor stream without any masking, a spatial masking stream with Central Spatial Masking (CSM), and a temporal masking stream with Motion Attention Temporal Masking (MATM).

Action Recognition Contrastive Learning +4

UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers

no code implementations31 Jan 2023 Dachuan Shi, Chaofan Tao, Ying Jin, Zhendong Yang, Chun Yuan, Jiaqi Wang

Real-world data contains a vast amount of multimodal information, among which vision and language are the two most representative modalities.

Image Classification Image Retrieval +4

Siamese transformer with hierarchical concept embedding for fine-grained image recognition

no code implementations Science China Information Sciences 2023 Yilin Lyu, Liping Jing, Jiaqi Wang, Mingzhe Guo, Xinyue Wang & Jian Yu

In particular, one subnetwork is for coarse-scale patches to learn the discriminative regions with the aid of the innate multi-head self-attention mechanism of the transformer.

Fine-Grained Image Recognition

Semi-Supervised Semantic Segmentation via Gentle Teaching Assistant

1 code implementation NIPS 2022 Ying Jin, Jiaqi Wang, Dahua Lin

Semi-Supervised Semantic Segmentation aims at training the segmentation model with limited labeled data and a large amount of unlabeled data.

Semi-Supervised Semantic Segmentation

Self-supervised Domain Adaptation for Breaking the Limits of Low-quality Fundus Image Quality Enhancement

1 code implementation17 Jan 2023 Qingshan Hou, Peng Cao, Jiaqi Wang, Xiaoli Liu, Jinzhu Yang, Osmar R. Zaiane

Most of the existing image enhancement methods mainly focus on improving the image quality by leveraging the guidance of high-quality images, which is difficult to be collected in medical applications.

Domain Adaptation Image Enhancement

Multi-Level Logit Distillation

1 code implementation CVPR 2023 Ying Jin, Jiaqi Wang, Dahua Lin

Through this framework, the prediction alignment is not only conducted at the instance level, but also at the batch and class level, through which the student model learns instance prediction, input correlation, and category correlation simultaneously.

Knowledge Distillation

In Differential Privacy, There is Truth: On Vote Leakage in Ensemble Private Learning

1 code implementation22 Sep 2022 Jiaqi Wang, Roei Schuster, Ilia Shumailov, David Lie, Nicolas Papernot

When learning from sensitive data, care must be taken to ensure that training algorithms address privacy concerns.

Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstruction

1 code implementation26 Aug 2022 Tong Wu, Jiaqi Wang, Xingang Pan, Xudong Xu, Christian Theobalt, Ziwei Liu, Dahua Lin

Previous methods based on neural volume rendering mostly train a fully implicit model with MLPs, which typically require hours of training for a single scene.

Surface Reconstruction

An Understanding-Oriented Robust Machine Reading Comprehension Model

1 code implementation1 Jul 2022 Feiliang Ren, Yongkang Liu, Bochao Li, Shilei Liu, Bingchao Wang, Jiaqi Wang, Chunchao Liu, Qi Ma

In this paper, we propose an understanding-oriented machine reading comprehension model to address three kinds of robustness issues, which are over sensitivity, over stability and generalization.

Machine Reading Comprehension Multi-Task Learning +1

Deep Amortized Relational Model with Group-Wise Hierarchical Generative Process

no code implementations AAAI 2022 Huafeng Liu, Tong Zhou, Jiaqi Wang, Liping Jing

In this paper, we propose Deep amortized Relational Model (DaRM) with group-wise hierarchical generative process for community discovery and link prediction on relational data (e. g., graph, network).

Community Detection Link Prediction

What Are Expected Queries in End-to-End Object Detection?

1 code implementation2 Jun 2022 Shilong Zhang, Xinjiang Wang, Jiaqi Wang, Jiangmiao Pang, Kai Chen

As both sparse and dense queries are imperfect, then \emph{what are expected queries in end-to-end object detection}?

Instance Segmentation object-detection +2

PYSKL: Towards Good Practices for Skeleton Action Recognition

1 code implementation19 May 2022 Haodong Duan, Jiaqi Wang, Kai Chen, Dahua Lin

The toolbox supports a wide variety of skeleton action recognition algorithms, including approaches based on GCN and CNN.

Action Recognition Skeleton Based Action Recognition

MINI: Mining Implicit Novel Instances for Few-Shot Object Detection

no code implementations6 May 2022 Yuhang Cao, Jiaqi Wang, Yiqi Lin, Dahua Lin

The offline mining mechanism leverages a self-supervised discriminative model to collaboratively mine implicit novel instances with a trained FSOD network.

Few-Shot Object Detection object-detection

Deep Understanding based Multi-Document Machine Reading Comprehension

no code implementations25 Feb 2022 Feiliang Ren, Yongkang Liu, Bochao Li, Zhibo Wang, Yu Guo, Shilei Liu, Huimin Wu, Jiaqi Wang, Chunchao Liu, Bingchao Wang

Most existing multi-document machine reading comprehension models mainly focus on understanding the interactions between the input question and documents, but ignore following two kinds of understandings.

Machine Reading Comprehension TriviaQA

LAVT: Language-Aware Vision Transformer for Referring Image Segmentation

1 code implementation CVPR 2022 Zhao Yang, Jiaqi Wang, Yansong Tang, Kai Chen, Hengshuang Zhao, Philip H. S. Torr

Referring image segmentation is a fundamental vision-language task that aims to segment out an object referred to by a natural language expression from an image.

Image Segmentation Referring Expression +2

Few-Shot Object Detection via Association and DIscrimination

1 code implementation NeurIPS 2021 Yuhang Cao, Jiaqi Wang, Ying Jin, Tong Wu, Kai Chen, Ziwei Liu, Dahua Lin

1) In the association step, in contrast to implicitly leveraging multiple base classes, we construct a compact novel class feature space via explicitly imitating a specific base class feature space.

Few-Shot Object Detection object-detection +2

FedTriNet: A Pseudo Labeling Method with Three Players for Federated Semi-supervised Learning

no code implementations12 Sep 2021 Liwei Che, Zewei Long, Jiaqi Wang, Yaqing Wang, Houping Xiao, Fenglong Ma

In particular, we propose to use three networks and a dynamic quality control mechanism to generate high-quality pseudo labels for unlabeled data, which are added to the training set.

Federated Learning

UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer

2 code implementations9 Sep 2021 Haonan Wang, Peng Cao, Jiaqi Wang, Osmar R. Zaiane

Specifically, the CTrans module is an alternate of the U-Net skip connections, which consists of a sub-module to conduct the multi-scale Channel Cross fusion with Transformer (named CCT) and a sub-module Channel-wise Cross-Attention (named CCA) to guide the fused multi-scale channel-wise information to effectively connect to the decoder features for eliminating the ambiguity.

 Ranked #1 on Medical Image Segmentation on GlaS (IoU metric)

Image Segmentation Medical Image Segmentation +1

FedCon: A Contrastive Framework for Federated Semi-Supervised Learning

no code implementations9 Sep 2021 Zewei Long, Jiaqi Wang, Yaqing Wang, Houping Xiao, Fenglong Ma

Most existing FedSSL methods focus on the classical scenario, i. e, the labeled and unlabeled data are stored at the client side.

Adaptively Optimize Content Recommendation Using Multi Armed Bandit Algorithms in E-commerce

no code implementations30 Jul 2021 Ding Xiang, Becky West, Jiaqi Wang, Xiquan Cui, Jinzhou Huang

Second, we compare the accumulative rewards of the three MAB algorithms with more than 1, 000 trials using actual historical A/B test datasets.

Thompson Sampling

Cluster-Wise Hierarchical Generative Model for Deep Amortized Clustering

no code implementations CVPR 2021 Huafeng Liu, Jiaqi Wang, Liping Jing

In this paper, we propose Cluster-wise Hierarchical Generative Model for deep amortized clustering (CHiGac).

Interpretable Image Recognition by Constructing Transparent Embedding Space

2 code implementations ICCV 2021 Jiaqi Wang, Huafeng Liu, Xinyue Wang, Liping Jing

This plug-in embedding space is spanned by transparent basis concepts which are constructed on the Grassmann manifold.

CARAFE++: Unified Content-Aware ReAssembly of FEatures

no code implementations7 Dec 2020 Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin

Feature reassembly, i. e. feature downsampling and upsampling, is a key operation in a number of modern convolutional network architectures, e. g., residual networks and feature pyramids.

Image Inpainting Instance Segmentation +3

CodeCMR: Cross-Modal Retrieval For Function-Level Binary Source Code Matching

1 code implementation NeurIPS 2020 Zeping Yu, Wenxin Zheng, Jiaqi Wang, Qiyi Tang, Sen Nie, Shi Wu

We adopt Deep Pyramid Convolutional Neural Network (DPCNN) for source code feature extraction and Graph Neural Network (GNN) for binary code feature extraction.

Computer Security Cross-Modal Retrieval +2

Texture Memory-Augmented Deep Patch-Based Image Inpainting

1 code implementation28 Sep 2020 Rui Xu, Minghao Guo, Jiaqi Wang, Xiaoxiao Li, Bolei Zhou, Chen Change Loy

By bringing together the best of both paradigms, we propose a new deep inpainting framework where texture generation is guided by a texture memory of patch samples extracted from unmasked regions.

Image Inpainting Retrieval +1

Active Learning for Product Type Ontology Enhancement in E-commerce

no code implementations19 Sep 2020 Yun Zhu, Sayyed M. Zahiri, Jiaqi Wang, Han-Yu Chen, Faizan Javed

Entity-based semantic search has been widely adopted in modern search engines to improve search accuracy by understanding users' intent.

Active Learning Vocal Bursts Type Prediction

MMFashion: An Open-Source Toolbox for Visual Fashion Analysis

3 code implementations18 May 2020 Xin Liu, Jiancheng Li, Jiaqi Wang, Ziwei Liu

This toolbox supports a wide spectrum of fashion analysis tasks, including Fashion Attribute Prediction, Fashion Recognition and Retrieval, Fashion Landmark Detection, Fashion Parsing and Segmentation and Fashion Compatibility and Recommendation.


FMore: An Incentive Scheme of Multi-dimensional Auction for Federated Learning in MEC

no code implementations22 Feb 2020 Rongfei Zeng, Shixun Zhang, Jiaqi Wang, Xiaowen Chu

In MEC, edge nodes would not like to voluntarily participate in learning, and they differ in the provision of multi-dimensional resources, both of which might deteriorate the performance of federated learning.

Edge-computing Federated Learning

Side-Aware Boundary Localization for More Precise Object Detection

3 code implementations ECCV 2020 Jiaqi Wang, Wenwei Zhang, Yuhang Cao, Kai Chen, Jiangmiao Pang, Tao Gong, Jianping Shi, Chen Change Loy, Dahua Lin

To tackle the difficulty of precise localization in the presence of displacements with large variance, we further propose a two-step localization scheme, which first predicts a range of movement through bucket prediction and then pinpoints the precise position within the predicted bucket.

object-detection Object Detection +1

On the Robustness of the Backdoor-based Watermarking in Deep Neural Networks

no code implementations18 Jun 2019 Masoumeh Shafieinejad, Jiaqi Wang, Nils Lukas, Xinda Li, Florian Kerschbaum

We focus on backdoor-based watermarking and propose two -- a black-box and a white-box -- attacks that remove the watermark.

CARAFE: Content-Aware ReAssembly of FEatures

3 code implementations ICCV 2019 Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin

CARAFE introduces little computational overhead and can be readily integrated into modern network architectures.

Instance Segmentation object-detection +2

Hierarchical Attention Generative Adversarial Networks for Cross-domain Sentiment Classification

no code implementations27 Mar 2019 Yuebing Zhang, Duoqian Miao, Jiaqi Wang

Cross-domain sentiment classification (CDSC) is an importance task in domain adaptation and sentiment classification.

Classification Domain Adaptation +3

Hybrid Task Cascade for Instance Segmentation

5 code implementations CVPR 2019 Kai Chen, Jiangmiao Pang, Jiaqi Wang, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jianping Shi, Wanli Ouyang, Chen Change Loy, Dahua Lin

In exploring a more effective approach, we find that the key to a successful instance segmentation cascade is to fully leverage the reciprocal relationship between detection and segmentation.

Instance Segmentation object-detection +2

Region Proposal by Guided Anchoring

2 code implementations CVPR 2019 Jiaqi Wang, Kai Chen, Shuo Yang, Chen Change Loy, Dahua Lin

State-of-the-art detectors mostly rely on a dense anchoring scheme, where anchors are sampled uniformly over the spatial domain with a predefined set of scales and aspect ratios.

object-detection Object Detection +1

Optimizing Video Object Detection via a Scale-Time Lattice

1 code implementation CVPR 2018 Kai Chen, Jiaqi Wang, Shuo Yang, Xingcheng Zhang, Yuanjun Xiong, Chen Change Loy, Dahua Lin

High-performance object detection relies on expensive convolutional networks to compute features, often leading to significant challenges in applications, e. g. those that require detecting objects from video streams in real time.

object-detection Video Object Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.