Search Results for author: Haibo Jin

Found 19 papers, 10 papers with code

JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Models

1 code implementation26 Jun 2024 Haibo Jin, Leyang Hu, Xinuo Li, Peiyan Zhang, Chonghan Chen, Jun Zhuang, Haohan Wang

The rapid evolution of artificial intelligence (AI) through developments in Large Language Models (LLMs) and Vision-Language Models (VLMs) has brought significant advancements across various technological domains.

Jailbreaking Large Language Models Against Moderation Guardrails via Cipher Characters

no code implementations30 May 2024 Haibo Jin, Andy Zhou, Joe D. Menke, Haohan Wang

To address this issue, we introduce JAMBench, a harmful behavior benchmark designed to trigger and evaluate moderation guardrails.

Rethinking Self-training for Semi-supervised Landmark Detection: A Selection-free Approach

1 code implementation6 Apr 2024 Haibo Jin, Haoxuan Che, Hao Chen

Pseudo pretraining and shrink regression are two essential components for such a curriculum, where the former is the first task of the curriculum for providing a better model initialization and the latter is further added in the later rounds to directly leverage the pseudo-labels in a coarse-to-fine manner.

Pseudo Label regression

Design as Desired: Utilizing Visual Question Answering for Multimodal Pre-training

no code implementations30 Mar 2024 Tongkun Su, Jun Li, Xi Zhang, Haibo Jin, Hao Chen, Qiong Wang, Faqin Lv, Baoliang Zhao, Yin Hu

In this work, we leverage descriptions in medical reports to design multi-granular question-answer pairs associated with different diseases, which assist the framework in pre-training without requiring extra annotations from experts.

Contrastive Learning Question Answering +1

GUARD: Role-playing to Generate Natural-language Jailbreakings to Test Guideline Adherence of Large Language Models

no code implementations5 Feb 2024 Haibo Jin, Ruoxi Chen, Andy Zhou, Yang Zhang, Haohan Wang

Our system of different roles will leverage this knowledge graph to generate new jailbreaks, which have proved effective in inducing LLMs to generate unethical or guideline-violating responses.

Sentence

Unsupervised Domain Adaptation for Anatomical Landmark Detection

1 code implementation25 Aug 2023 Haibo Jin, Haoxuan Che, Hao Chen

The framework leverages self-training and domain adversarial learning to address the domain gap during adaptation.

Anatomical Landmark Detection Unsupervised Domain Adaptation

PromptMRG: Diagnosis-Driven Prompts for Medical Report Generation

1 code implementation24 Aug 2023 Haibo Jin, Haoxuan Che, Yi Lin, Hao Chen

To address these challenges, we propose diagnosis-driven prompts for medical report generation (PromptMRG), a novel framework that aims to improve the diagnostic accuracy of MRG with the guidance of diagnosis-aware prompts.

Medical Report Generation

CertPri: Certifiable Prioritization for Deep Neural Networks via Movement Cost in Feature Space

no code implementations18 Jul 2023 Haibin Zheng, Jinyin Chen, Haibo Jin

Therefore, it is crucial to identify the misbehavior of DNN-based software and improve DNNs' quality.

Towards Generalizable Diabetic Retinopathy Grading in Unseen Domains

1 code implementation10 Jul 2023 Haoxuan Che, YuHan Cheng, Haibo Jin, Hao Chen

Diabetic Retinopathy (DR) is a common complication of diabetes and a leading cause of blindness worldwide.

Diabetic Retinopathy Grading Domain Generalization

TraffNet: Learning Causality of Traffic Generation for What-if Prediction

2 code implementations28 Mar 2023 Ming Xu, Qiang Ai, Ruimin Li, Yunyi Ma, Geqi Qi, Xiangfu Meng, Haibo Jin

Real-time what-if traffic prediction is crucial for decision making in intelligent traffic management and control.

Decision Making Management +1

AdvCheck: Characterizing Adversarial Examples via Local Gradient Checking

no code implementations25 Mar 2023 Ruoxi Chen, Haibo Jin, Jinyin Chen, Haibin Zheng

To address the issues, we introduce the concept of local gradient, and reveal that adversarial examples have a quite larger bound of local gradient than the benign ones.

Learning Robust Representation for Joint Grading of Ophthalmic Diseases via Adaptive Curriculum and Feature Disentanglement

no code implementations9 Jul 2022 Haoxuan Che, Haibo Jin, Hao Chen

However, prior works either grade DR or DME independently, without considering internal correlations between them, or grade them jointly by shared feature representation, yet ignoring potential generalization issues caused by difficult samples and data bias.

Disentanglement

Excitement Surfeited Turns to Errors: Deep Learning Testing Framework Based on Excitable Neurons

1 code implementation12 Feb 2022 Haibo Jin, Ruoxi Chen, Haibin Zheng, Jinyin Chen, Yao Cheng, Yue Yu, Xianglong Liu

By maximizing the number of excitable neurons concerning various wrong behaviors of models, DeepSensor can generate testing examples that effectively trigger more errors due to adversarial inputs, polluted data and incomplete training.

Image Classification Speaker Recognition

Fight Perturbations with Perturbations: Defending Adversarial Attacks via Neuron Influence

1 code implementation24 Dec 2021 Ruoxi Chen, Haibo Jin, Haibin Zheng, Jinyin Chen, Zhenguang Liu

In this paper, we consider defense methods from the general effect of adversarial attacks that take on neurons inside the model.

CatchBackdoor: Backdoor Detection via Critical Trojan Neural Path Fuzzing

no code implementations24 Dec 2021 Haibo Jin, Ruoxi Chen, Jinyin Chen, Haibin Zheng, Yang Zhang, Haohan Wang

Extensive experiments on MINST, CIFAR-10, and a-ImageNet datasets and 7 models (LeNet, ResNet, and VGG) demonstrate the superiority of CatchBackdoor over the state-of-the-art methods, in terms of (1) \emph{effective} - it shows better detection performance, especially on stealthy attacks ($\sim$ $\times$ 2 on average); (2) \emph{extensible} - it is robust to trigger size and can conduct detection without benign examples.

DNN Testing

When Liebig's Barrel Meets Facial Landmark Detection: A Practical Model

no code implementations27 May 2021 Haibo Jin, Jinpeng Li, Shengcai Liao, Ling Shao

To this end, we first propose a baseline model equipped with one transformer decoder as detection head.

Decoder Face Alignment +1

Pixel-in-Pixel Net: Towards Efficient Facial Landmark Detection in the Wild

2 code implementations8 Mar 2020 Haibo Jin, Shengcai Liao, Ling Shao

The proposed model is equipped with a novel detection head based on heatmap regression, which conducts score and offset predictions simultaneously on low-resolution feature maps.

Domain Generalization Face Alignment +2

Deep Person Re-Identification with Improved Embedding and Efficient Training

1 code implementation9 May 2017 Haibo Jin, Xiaobo Wang, Shengcai Liao, Stan Z. Li

However, to achieve this, existing deep models prefer to adopt image pairs or triplets to form verification loss, which is inefficient and unstable since the number of training pairs or triplets grows rapidly as the number of training data grows.

Person Re-Identification

Cannot find the paper you are looking for? You can Submit a new open access paper.