Search Results for author: Yao Qin

Found 37 papers, 11 papers with code

Mix from Failure: Confusion-Pairing Mixup for Long-Tailed Recognition

no code implementations12 Nov 2024 Youngseok Yoon, Sangwoo Hong, Hyungjoon Joo, Yao Qin, Haewon Jeong, Jungwoo Lee

Long-tailed image recognition is a computer vision problem considering a real-world class distribution rather than an artificial uniform.

Diversity

Conflict-Aware Adversarial Training

no code implementations21 Oct 2024 Zhiyu Xue, Haohan Wang, Yao Qin, Ramtin Pedarsani

Adversarial training is the most effective method to obtain adversarial robustness for deep neural networks by directly involving adversarial samples in the training procedure.

Adversarial Robustness

Creative and Context-Aware Translation of East Asian Idioms with GPT-4

1 code implementation1 Oct 2024 Kenan Tang, Peiyang Song, Yao Qin, Xifeng Yan

As a type of figurative language, an East Asian idiom condenses rich cultural background into only a few characters.

Translation

Automated Adversarial Discovery for Safety Classifiers

no code implementations24 Jun 2024 Yash Kumar Lal, Preethi Lahoti, Aradhana Sinha, Yao Qin, Ananth Balashankar

We formalize the task of automated adversarial discovery for safety classifiers - to find new attacks along previously unseen harm dimensions that expose new weaknesses in the classifier.

Diversity

A Minimalist Prompt for Zero-Shot Policy Learning

no code implementations9 May 2024 Meng Song, Xuezhi Wang, Tanay Biradar, Yao Qin, Manmohan Chandraker

Transformer-based methods have exhibited significant generalization ability when prompted with target-domain demonstrations or example solutions during inference.

Zero-shot Generalization

Fast Decision Boundary based Out-of-Distribution Detector

1 code implementation15 Dec 2023 Litian Liu, Yao Qin

By regularizing the distances to decision boundaries based on feature deviation from the mean, we develop a hyperparameter-free, auxiliary model-free OOD detector.

Computational Efficiency Out of Distribution (OOD) Detection

Initialization Matters for Adversarial Transfer Learning

1 code implementation CVPR 2024 Andong Hua, Jindong Gu, Zhiyu Xue, Nicholas Carlini, Eric Wong, Yao Qin

Based on this, we propose Robust Linear Initialization (RoLI) for adversarial finetuning, which initializes the linear head with the weights obtained by adversarial linear probing to maximally inherit the robustness from pretraining.

Adversarial Robustness Image Classification +1

Detecting Out-of-Distribution Through the Lens of Neural Collapse

no code implementations2 Nov 2023 Litian Liu, Yao Qin

By analyzing this trend, we discover that features of in-distribution (ID) samples cluster closer to the weight vectors compared to features of OOD samples.

Out of Distribution (OOD) Detection

Improving Robustness via Tilted Exponential Layer: A Communication-Theoretic Perspective

1 code implementation2 Nov 2023 Bhagyashree Puranik, Ahmad Beirami, Yao Qin, Upamanyu Madhow

State-of-the-art techniques for enhancing robustness of deep networks mostly rely on empirical risk minimization with suitable data augmentation.

Data Augmentation

Improving Few-shot Generalization of Safety Classifiers via Data Augmented Parameter-Efficient Fine-Tuning

no code implementations25 Oct 2023 Ananth Balashankar, Xiao Ma, Aradhana Sinha, Ahmad Beirami, Yao Qin, Jilin Chen, Alex Beutel

As large language models (LLMs) are widely adopted, new safety issues and policies emerge, to which existing safety classifiers do not generalize well.

Data Augmentation Few-Shot Learning +2

A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models

2 code implementations24 Jul 2023 Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami, Bailan He, Gengyuan Zhang, Ruotong Liao, Yao Qin, Volker Tresp, Philip Torr

This paper aims to provide a comprehensive survey of cutting-edge research in prompt engineering on three types of vision-language models: multimodal-to-text generation models (e. g. Flamingo), image-text matching models (e. g.

Image-text matching Language Modelling +4

Enhancing Small Medical Learners with Privacy-preserving Contextual Prompting

1 code implementation22 May 2023 Xinlu Zhang, Shiyang Li, Xianjun Yang, Chenxin Tian, Yao Qin, Linda Ruth Petzold

Although offering improved data privacy protection, domain-specific small language models (SLMs) often underperform LLMs, emphasizing the need for methods that reduce this performance gap while alleviating privacy concerns.

Decision Making Privacy Preserving

Improving Classifier Robustness through Active Generation of Pairwise Counterfactuals

no code implementations22 May 2023 Ananth Balashankar, Xuezhi Wang, Yao Qin, Ben Packer, Nithum Thain, Jilin Chen, Ed H. Chi, Alex Beutel

We demonstrate that with a small amount of human-annotated counterfactual data (10%), we can generate a counterfactual augmentation dataset with learned labels, that provides an 18-20% improvement in robustness and a 14-21% reduction in errors on 6 out-of-domain datasets, comparable to that of a fully human-annotated counterfactual dataset for both sentiment classification and question paraphrase tasks.

counterfactual Data Augmentation +2

Towards Robust Prompts on Vision-Language Models

no code implementations17 Apr 2023 Jindong Gu, Ahmad Beirami, Xuezhi Wang, Alex Beutel, Philip Torr, Yao Qin

With the advent of vision-language models (VLMs) that can perform in-context and prompt-based learning, how can we design prompting approaches that robustly generalize to distribution shift and can be used on novel classes outside the support set of the prompts?

In-Context Learning

Training Deep Boltzmann Networks with Sparse Ising Machines

no code implementations19 Mar 2023 Shaila Niazi, Navid Anjum Aadit, Masoud Mohseni, Shuvro Chowdhury, Yao Qin, Kerem Y. Camsari

These results demonstrate the potential of using Ising machines for traditionally hard-to-train deep generative Boltzmann networks, with further possible improvement in nanodevice-based realizations.

Combinatorial Optimization

What Are Effective Labels for Augmented Data? Improving Calibration and Robustness with AutoLabel

no code implementations22 Feb 2023 Yao Qin, Xuezhi Wang, Balaji Lakshminarayanan, Ed H. Chi, Alex Beutel

A wide breadth of research has devised data augmentation approaches that can improve both accuracy and generalization performance for neural networks.

Data Augmentation

Adjacent-Level Feature Cross-Fusion With 3-D CNN for Remote Sensing Image Change Detection

1 code implementation10 Feb 2023 Yuanxin Ye, Mengmeng Wang, Liang Zhou, Guangyang Lei, Jianwei Fan, Yao Qin

First, through the inner fusion property of 3D convolution, we design a new feature fusion way that can simultaneously extract and fuse the feature information from bi-temporal images.

Change Detection

Investigating Ensemble Methods for Model Robustness Improvement of Text Classifiers

no code implementations28 Oct 2022 Jieyu Zhao, Xuezhi Wang, Yao Qin, Jilin Chen, Kai-Wei Chang

Large pre-trained language models have shown remarkable performance over the past few years.

Are Vision Transformers Robust to Patch Perturbations?

no code implementations20 Nov 2021 Jindong Gu, Volker Tresp, Yao Qin

However, when ViTs are attacked by an adversary, the attention mechanism can be easily fooled to focus more on the adversarially perturbed patches and cause a mistake.

Image Classification

Understanding and Improving Robustness of Vision Transformers through Patch-based Negative Augmentation

no code implementations15 Oct 2021 Yao Qin, Chiyuan Zhang, Ting Chen, Balaji Lakshminarayanan, Alex Beutel, Xuezhi Wang

We show that patch-based negative augmentation consistently improves robustness of ViTs across a wide set of ImageNet based robustness benchmarks.

Data Augmentation

Are Vision Transformers Robust to Patch-wise Perturbations?

no code implementations29 Sep 2021 Jindong Gu, Volker Tresp, Yao Qin

Based on extensive qualitative and quantitative experiments, we discover that ViT's stronger robustness to natural corrupted patches and higher vulnerability against adversarial patches are both caused by the attention mechanism.

Image Classification

A Multiscale Graph Convolutional Network for Change Detection in Homogeneous and Heterogeneous Remote Sensing Images

no code implementations16 Feb 2021 Junzheng Wu, Biao Li, Yao Qin, Weiping Ni, Han Zhang, Yuli Sun

In this paper, a novel CD method based on the graph convolutional network (GCN) and multiscale object-based technique is proposed for both homogeneous and heterogeneous images.

Change Detection

What are effective labels for augmented data? Improving robustness with AutoLabel

no code implementations1 Jan 2021 Yao Qin, Xuezhi Wang, Balaji Lakshminarayanan, Ed Chi, Alex Beutel

Despite this, most existing work simply reuses the original label from the clean data, and the choice of label accompanying the augmented data is relatively less explored.

Adversarial Robustness Data Augmentation

CAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generation

no code implementations EMNLP 2020 Tianlu Wang, Xuezhi Wang, Yao Qin, Ben Packer, Kang Li, Jilin Chen, Alex Beutel, Ed Chi

Experiments on real-world NLP datasets demonstrate that our method can generate more diverse and fluent adversarial texts, compared to many existing adversarial text generation approaches.

Adversarial Text Attribute +3

Improving Calibration through the Relationship with Adversarial Robustness

no code implementations NeurIPS 2021 Yao Qin, Xuezhi Wang, Alex Beutel, Ed H. Chi

To this end, we propose Adversarial Robustness based Adaptive Label Smoothing (AR-AdaLS) that integrates the correlations of adversarial robustness and calibration into training by adaptively softening labels for an example based on how easily it can be attacked by an adversary.

Adversarial Robustness

Deflecting Adversarial Attacks

no code implementations18 Feb 2020 Yao Qin, Nicholas Frosst, Colin Raffel, Garrison Cottrell, Geoffrey Hinton

There has been an ongoing cycle where stronger defenses against adversarial attacks are subsequently broken by a more advanced defense-aware attack.

Detecting and Diagnosing Adversarial Images with Class-Conditional Capsule Reconstructions

no code implementations ICLR 2020 Yao Qin, Nicholas Frosst, Sara Sabour, Colin Raffel, Garrison Cottrell, Geoffrey Hinton

Then, we diagnose the adversarial examples for CapsNets and find that the success of the reconstructive attack is highly related to the visual similarity between the source and target class.

Cross-Domain Collaborative Learning via Cluster Canonical Correlation Analysis and Random Walker for Hyperspectral Image Classification

no code implementations29 Aug 2018 Yao Qin, Lorenzo Bruzzone, Biao Li, Yuanxin Ye

To be specific, the proposed CDCL method is an iterative process of three main stages, i. e. twice of RW-based pseudolabeling and cross domain learning via C-CCA.

Domain Adaptation General Classification +1

Tensor Alignment Based Domain Adaptation for Hyperspectral Image Classification

no code implementations29 Aug 2018 Yao Qin, Lorenzo Bruzzone, Biao Li

Then we consider the subspace invariance between two domains as projection matrices and original tensors are projected as core tensors with lower dimensions into the invariant tensor subspace by applying Tucker decomposition.

Classification Domain Adaptation +3

Autofocus Layer for Semantic Segmentation

3 code implementations22 May 2018 Yao Qin, Konstantinos Kamnitsas, Siddharth Ancha, Jay Nanavati, Garrison Cottrell, Antonio Criminisi, Aditya Nori

We propose the autofocus convolutional layer for semantic segmentation with the objective of enhancing the capabilities of neural networks for multi-scale processing.

Brain Tumor Segmentation Organ Segmentation +2

Hierarchical Cellular Automata for Visual Saliency

1 code implementation26 May 2017 Yao Qin, Mengyang Feng, Huchuan Lu, Garrison W. Cottrell

The CCA can act as an efficient pixel-wise aggregation algorithm that can integrate state-of-the-art methods, resulting in even better results.

Saliency Detection

A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction

13 code implementations7 Apr 2017 Yao Qin, Dongjin Song, Haifeng Chen, Wei Cheng, Guofei Jiang, Garrison Cottrell

The Nonlinear autoregressive exogenous (NARX) model, which predicts the current value of a time series based upon its previous values as well as the current and past values of multiple driving (exogenous) series, has been studied for decades.

Time Series Time Series Prediction

Saliency Detection via Cellular Automata

no code implementations CVPR 2015 Yao Qin, Huchuan Lu, Yiqun Xu, He Wang

In this paper, we introduce Cellular Automata--a dynamic evolution model to intuitively detect the salient object.

Saliency Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.