Search Results for author: Shuai Zhao

Found 39 papers, 13 papers with code

Focus on Local Regions for Query-based Object Detection

no code implementations10 Oct 2023 Hongbin Xu, Yamei Xia, Shuai Zhao, Bo Cheng

We also design the adaptive sampling method to extract effective features based on queries' local regions from feature maps.

object-detection Object Detection

Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models

1 code implementation29 May 2023 Shuai Zhao, Xiaohan Wang, Linchao Zhu, Yi Yang

Specifically, we adopt CLIP as reward model to provide feedback for VL models during test time in various tasks, including image classification, image-text retrieval, and image captioning.

Image Captioning Image Classification +3

CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model

1 code implementation23 May 2023 Shuai Zhao, Xiaohan Wang, Linchao Zhu, Ruijie Quan, Yi Yang

With such merits, we transform CLIP into a scene text reader and introduce CLIP4STR, a simple yet effective STR method built upon image and text encoders of CLIP.

 Ranked #1 on Scene Text Recognition on WOST (using extra training data)

Language Modelling Scene Text Recognition

Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Models

1 code implementation2 May 2023 Shuai Zhao, Jinming Wen, Luu Anh Tuan, Junbo Zhao, Jie Fu

Our method does not require external triggers and ensures correct labeling of poisoned samples, improving the stealthy nature of the backdoor attack.

Backdoor Attack Few-Shot Text Classification +2

Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding

1 code implementation2 Mar 2023 Yingting Li, Ambuj Mehrish, Shuai Zhao, Rishabh Bhardwaj, Amir Zadeh, Navonil Majumder, Rada Mihalcea, Soujanya Poria

To mitigate this issue, parameter-efficient transfer learning algorithms, such as adapters and prefix tuning, have been proposed as a way to introduce a few trainable parameters that can be plugged into large pre-trained language models such as BERT, and HuBERT.

Speech Synthesis Transfer Learning

Physics-Informed Neural Networks for Prognostics and Health Management of Lithium-Ion Batteries

1 code implementation2 Jan 2023 Pengfei Wen, Zhi-Sheng Ye, Yong Li, Shaowei Chen, Pu Xie, Shuai Zhao

Physics-Informed Neural Network (PINN) is an efficient tool to fuse empirical or physical dynamic models with data-driven models.


AutoPINN: When AutoML Meets Physics-Informed Neural Networks

no code implementations8 Dec 2022 Xinle Wu, Dalin Zhang, Miao Zhang, Chenjuan Guo, Shuai Zhao, Yi Zhang, Huai Wang, Bin Yang

We then propose a resource-aware search strategy to explore the search space to find the best PINN model under different resource constraints.


Generative Prompt Tuning for Relation Classification

1 code implementation22 Oct 2022 Jiale Han, Shuai Zhao, Bo Cheng, Shengkun Ma, Wei Lu

Current prompt tuning methods mostly convert the downstream tasks to masked language modeling problems by adding cloze-style phrases and mapping all labels to verbalizations with fixed length, which has proven effective for tasks with simple label spaces.

Classification Language Modelling +3

Slimmable Networks for Contrastive Self-supervised Learning

no code implementations30 Sep 2022 Shuai Zhao, Xiaohan Wang, Linchao Zhu, Yi Yang

In this work, we present a one-stage solution to obtain pre-trained small models without the need for extra teachers, namely, slimmable networks for contrastive self-supervised learning (\emph{SlimCLR}).

Contrastive Learning Knowledge Distillation +1

Learning Personalized Representations using Graph Convolutional Network

no code implementations28 Jul 2022 Hongyu Shen, Jinoh Oh, Shuai Zhao, Guoyin Wang, Tara Taghavi, Sungjin Lee

Then we propose a graph convolutional network(GCN) based model, namely Personalized Dynamic Routing Feature Encoder(PDRFE), that generates personalized customer representations learned from the built graph.

Analyzing Modality Robustness in Multimodal Sentiment Analysis

1 code implementation NAACL 2022 Devamanyu Hazarika, Yingting Li, Bo Cheng, Shuai Zhao, Roger Zimmermann, Soujanya Poria

In this work, we hope to address that by (i) Proposing simple diagnostic checks for modality robustness in a trained multimodal model.

Multimodal Sentiment Analysis

Exploring Entity Interactions for Few-Shot Relation Learning (Student Abstract)

no code implementations4 May 2022 Yi Liang, Shuai Zhao, Bo Cheng, Yuwei Yin, Hao Yang

Few-shot relation learning refers to infer facts for relations with a limited number of observed triples.

Metric Learning

CenterCLIP: Token Clustering for Efficient Text-Video Retrieval

1 code implementation2 May 2022 Shuai Zhao, Linchao Zhu, Xiaohan Wang, Yi Yang

In this paper, to reduce the number of redundant video tokens, we design a multi-segment token clustering algorithm to find the most representative tokens and drop the non-essential ones.

Ranked #9 on Video Retrieval on MSVD (using extra training data)

Clustering Retrieval +1

WuDaoMM: A large-scale Multi-Modal Dataset for Pre-training models

no code implementations22 Mar 2022 Sha Yuan, Shuai Zhao, Jiahong Leng, Zhao Xue, Hanyu Zhao, Peiyu Liu, Zheng Gong, Wayne Xin Zhao, Junyi Li, Jie Tang

The results show that WuDaoMM can be applied as an efficient dataset for VLPMs, especially for the model in text-to-image generation task.

Image Captioning Question Answering +1

Learning Dynamic Compact Memory Embedding for Deformable Visual Object Tracking

no code implementations23 Nov 2021 Pengfei Zhu, Hongtao Yu, Kaihua Zhang, Yu Wang, Shuai Zhao, Lei Wang, Tianzhu Zhang, QinGhua Hu

To address this issue, segmentation-based trackers have been proposed that employ per-pixel matching to improve the tracking performance of deformable objects effectively.

Segmentation Visual Object Tracking +1

FCM: A Fine-grained Comparison Model for Multi-turn Dialogue Reasoning

no code implementations Findings (EMNLP) 2021 Xu Wang, Hainan Zhang, Shuai Zhao, Yanyan Zou, Hongshen Chen, Zhuoye Ding, Bo Cheng, Yanyan Lan

Furthermore, the consistency signals between each candidate and the speaker's own history are considered to drive a model to prefer a candidate that is logically consistent with the speaker's history logic.

Reading Comprehension

Attacking Adversarial Attacks as A Defense

no code implementations9 Jun 2021 Boxi Wu, Heng Pan, Li Shen, Jindong Gu, Shuai Zhao, Zhifeng Li, Deng Cai, Xiaofei He, Wei Liu

In this work, we find that the adversarial attacks can also be vulnerable to small perturbations.

SCALoss: Side and Corner Aligned Loss for Bounding Box Regression

1 code implementation1 Apr 2021 Tu Zheng, Shuai Zhao, Yang Liu, Zili Liu, Deng Cai

In this paper, we propose Side Overlap~(SO) loss by maximizing the side overlap of two bounding boxes, which puts more penalty for low overlapping bounding box cases.

object-detection Object Detection +1

Integrating Subgraph-aware Relation and DirectionReasoning for Question Answering

no code implementations1 Apr 2021 Xu Wang, Shuai Zhao, Bo Cheng, Jiale Han, Yingting Li, Hao Yang, Ivan Sekulic, Guoshun Nan

Question Answering (QA) models over Knowledge Bases (KBs) are capable of providing more precise answers by utilizing relation information among entities.

Question Answering

ES-Net: Erasing Salient Parts to Learn More in Re-Identification

no code implementations10 Mar 2021 Dong Shen, Shuai Zhao, Jinming Hu, Hao Feng, Deng Cai, Xiaofei He

In this paper, we propose a novel network, Erasing-Salient Net (ES-Net), to learn comprehensive features by erasing the salient areas in an image.

Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework

no code implementations10 Oct 2020 Wenxiao Wang, Minghao Chen, Shuai Zhao, Long Chen, Jinming Hu, Haifeng Liu, Deng Cai, Xiaofei He, Wei Liu

Specifically, it first casts the relationships between a certain model's accuracy and depth/width/resolution into a polynomial regression and then maximizes the polynomial to acquire the optimal values for the three dimensions.

Network Pruning Neural Architecture Search +1

Adversarial-Learned Loss for Domain Adaptation

1 code implementation4 Jan 2020 Minghao Chen, Shuai Zhao, Haifeng Liu, Deng Cai

In order to combine the strengths of these two methods, we propose a novel method called Adversarial-Learned Loss for Domain Adaptation (ALDA).

Domain Adaptation Pseudo Label

DBP: Discrimination Based Block-Level Pruning for Deep Model Acceleration

no code implementations21 Dec 2019 Wenxiao Wang, Shuai Zhao, Minghao Chen, Jinming Hu, Deng Cai, Haifeng Liu

The dominant pruning methods, filter-level pruning methods, evaluate their performance through the reduction ratio of computations and deem that a higher reduction ratio of computations is equivalent to a higher acceleration ratio in terms of inference time.

Network Pruning

Region Mutual Information Loss for Semantic Segmentation

2 code implementations NeurIPS 2019 Shuai Zhao, Yang Wang, Zheng Yang, Deng Cai

In this paper, we develop a region mutual information (RMI) loss to model the dependencies among pixels more simply and efficiently.

Semantic Segmentation

Correlation Maximized Structural Similarity Loss for Semantic Segmentation

no code implementations19 Oct 2019 Shuai Zhao, Boxi Wu, Wenqing Chu, Yao Hu, Deng Cai

Inspired by the widely-used structural similarity (SSIM) index in image quality assessment, we use the linear correlation between two images to quantify their structural similarity.

Image Quality Assessment Semantic Segmentation +1

Heavy quark expansion for heavy-light light-cone operators

no code implementations8 Oct 2019 Shuai Zhao

We generalize the celebrated heavy quark expansion to nonlocal QCD operators.

High Energy Physics - Phenomenology

ACE-Net: Biomedical Image Segmentation with Augmented Contracting and Expansive Paths

no code implementations23 Aug 2019 Yanhao Zhu, Zhineng Chen, Shuai Zhao, Hongtao Xie, Wenming Guo, Yongdong Zhang

Nowadays U-net-like FCNs predominate various biomedical image segmentation applications and attain promising performance, largely due to their elegant architectures, e. g., symmetric contracting and expansive paths as well as lateral skip-connections.

Image Segmentation Segmentation +1

Improving Semantic Segmentation via Dilated Affinity

no code implementations16 Jul 2019 Boxi Wu, Shuai Zhao, Wenqing Chu, Zheng Yang, Deng Cai

To be specific, our method explicitly requires the network to predict semantic segmentation as well as dilated affinity, which is a sparse version of pair-wise pixel affinity.

Segmentation Semantic Segmentation

An End-to-End Multi-task Learning Model for Fact Checking

no code implementations WS 2018 Sizhen Li, Shuai Zhao, Bo Cheng, Hao Yang

With huge amount of information generated every day on the web, fact checking is an important and challenging task which can help people identify the authenticity of most claims as well as providing evidences selected from knowledge source like Wikipedia.

Common Sense Reasoning Entity Linking +5

Packaging and Sharing Machine Learning Models via the Acumos AI Open Platform

no code implementations16 Oct 2018 Shuai Zhao, Manoop Talasila, Guy Jacobson, Cristian Borcea, Syed Anwar Aftab, John F Murray

Applying Machine Learning (ML) to business applications for automation usually faces difficulties when integrating diverse ML dependencies and services, mainly because of the lack of a common ML framework.

BIG-bench Machine Learning Sentiment Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.