Search Results for author: Hongbin Liu

Found 24 papers, 7 papers with code

Mudjacking: Patching Backdoor Vulnerabilities in Foundation Models

no code implementations22 Feb 2024 Hongbin Liu, Michael K. Reiter, Neil Zhenqiang Gong

However, foundation models are vulnerable to backdoor attacks and a backdoored foundation model is a single-point-of-failure of the AI ecosystem, e. g., multiple downstream classifiers inherit the backdoor vulnerabilities simultaneously.

Visual Hallucinations of Multi-modal Large Language Models

1 code implementation22 Feb 2024 Wen Huang, Hongbin Liu, Minxin Guo, Neil Zhenqiang Gong

We find that existing MLLMs such as GPT-4V, LLaVA-1. 5, and MiniGPT-v2 hallucinate for a large fraction of the instances in our benchmark.

Hallucination Question Answering +1

DaFoEs: Mixing Datasets towards the generalization of vision-state deep-learning Force Estimation in Minimally Invasive Robotic Surgery

1 code implementation17 Jan 2024 Mikel De Iturrate Reyzabal, Mingcong Chen, Wei Huang, Sebastien Ourselin, Hongbin Liu

In this paper, we present a new vision-haptic dataset (DaFoEs) with variable soft environments for the training of deep neural models.

SurgPLAN: Surgical Phase Localization Network for Phase Recognition

no code implementations16 Nov 2023 Xingjian Luo, You Pang, Zhen Chen, Jinlin Wu, Zongmin Zhang, Zhen Lei, Hongbin Liu

To address these two challenges, we propose a Surgical Phase LocAlization Network, named SurgPLAN, to facilitate a more accurate and stable surgical phase recognition with the principle of temporal detection.

Surgical phase recognition

PWISeg: Point-based Weakly-supervised Instance Segmentation for Surgical Instruments

1 code implementation16 Nov 2023 Zhen Sun, Huan Xu, Jinlin Wu, Zhen Chen, Zhen Lei, Hongbin Liu

To address this issue, we propose a novel yet effective weakly-supervised surgical instrument instance segmentation approach, named Point-based Weakly-supervised Instance Segmentation (PWISeg).

Instance Segmentation Segmentation +4

PointCert: Point Cloud Classification with Deterministic Certified Robustness Guarantees

no code implementations CVPR 2023 Jinghuai Zhang, Jinyuan Jia, Hongbin Liu, Neil Zhenqiang Gong

Existing certified defenses against adversarial point clouds suffer from a key limitation: their certified robustness guarantees are probabilistic, i. e., they produce an incorrect certified robustness guarantee with some probability.

Autonomous Driving Classification +1

Pre-trained Encoders in Self-Supervised Learning Improve Secure and Privacy-preserving Supervised Learning

no code implementations6 Dec 2022 Hongbin Liu, Wenjie Qu, Jinyuan Jia, Neil Zhenqiang Gong

In this work, we perform the first systematic, principled measurement study to understand whether and when a pre-trained encoder can address the limitations of secure or privacy-preserving supervised learning algorithms.

Data Poisoning Machine Unlearning +2

CorruptEncoder: Data Poisoning based Backdoor Attacks to Contrastive Learning

no code implementations15 Nov 2022 Jinghuai Zhang, Hongbin Liu, Jinyuan Jia, Neil Zhenqiang Gong

In this work, we take the first step to analyze the limitations of existing backdoor attacks and propose new DPBAs called CorruptEncoder to CL.

Contrastive Learning Data Poisoning

Semi-Leak: Membership Inference Attacks Against Semi-supervised Learning

1 code implementation25 Jul 2022 Xinlei He, Hongbin Liu, Neil Zhenqiang Gong, Yang Zhang

The results show that early stopping can mitigate the membership inference attack, but with the cost of model's utility degradation.

Data Augmentation Inference Attack +1

StolenEncoder: Stealing Pre-trained Encoders in Self-supervised Learning

no code implementations15 Jan 2022 Yupei Liu, Jinyuan Jia, Hongbin Liu, Neil Zhenqiang Gong

A pre-trained encoder may be deemed confidential because its training requires lots of data and computation resources as well as its public release may facilitate misuse of AI, e. g., for deepfakes generation.

Self-Supervised Learning

EncoderMI: Membership Inference against Pre-trained Encoders in Contrastive Learning

no code implementations25 Aug 2021 Hongbin Liu, Jinyuan Jia, Wenjie Qu, Neil Zhenqiang Gong

EncoderMI can be used 1) by a data owner to audit whether its (public) data was used to pre-train an image encoder without its authorization or 2) by an attacker to compromise privacy of the training data when it is private/sensitive.

Contrastive Learning

PointGuard: Provably Robust 3D Point Cloud Classification

no code implementations CVPR 2021 Hongbin Liu, Jinyuan Jia, Neil Zhenqiang Gong

Our first major theoretical contribution is that we show PointGuard provably predicts the same label for a 3D point cloud when the number of adversarially modified, added, and/or deleted points is bounded.

3D Point Cloud Classification Autonomous Driving +4

Prospects of Quantum Computing for Molecular Sciences

no code implementations19 Feb 2021 Hongbin Liu, Guang Hao Low, Damian S. Steiger, Thomas Häner, Markus Reiher, Matthias Troyer

Molecular science is governed by the dynamics of electrons, atomic nuclei, and their interaction with electromagnetic fields.

Quantum Physics

Almost Tight L0-norm Certified Robustness of Top-k Predictions against Adversarial Perturbations

no code implementations ICLR 2022 Jinyuan Jia, Binghui Wang, Xiaoyu Cao, Hongbin Liu, Neil Zhenqiang Gong

For instance, our method can build a classifier that achieves a certified top-3 accuracy of 69. 2\% on ImageNet when an attacker can arbitrarily perturb 5 pixels of a testing image.

Recommendation Systems

Bounding Boxes Are All We Need: Street View Image Classification via Context Encoding of Detected Buildings

1 code implementation3 Oct 2020 Kun Zhao, Yongkun Liu, Siyuan Hao, Shaoxing Lu, Hongbin Liu, Lijian Zhou

Instead of using visual features of the whole image directly as common image-level models based on convolutional neural networks (CNNs) do, the proposed framework firstly obtains the bounding boxes of buildings in street view images from a detector.

General Classification Image Classification

On the Intrinsic Differential Privacy of Bagging

no code implementations22 Aug 2020 Hongbin Liu, Jinyuan Jia, Neil Zhenqiang Gong

Bagging, a popular ensemble learning framework, randomly creates some subsamples of the training data, trains a base model for each subsample using a base learner, and takes majority vote among the base models when making predictions.

BIG-bench Machine Learning Ensemble Learning

Knock-Knock: Acoustic Object Recognition by using Stacked Denoising Autoencoders

no code implementations15 Aug 2017 Shan Luo, Leqi Zhu, Kaspar Althoefer, Hongbin Liu

A traditional method using handcrafted features with a shallow classifier was taken as a benchmark and the attained recognition rate was only 58. 22%.

Denoising Object +1

Cannot find the paper you are looking for? You can Submit a new open access paper.