Search Results for author: Xiaofeng Cao

Found 22 papers, 5 papers with code

Mitigating Privacy Risk in Membership Inference by Convex-Concave Loss

no code implementations8 Feb 2024 Zhenlong Liu, Lei Feng, Huiping Zhuang, Xiaofeng Cao, Hongxin Wei

In this work, we propose a novel method -- Convex-Concave Loss, which enables a high variance of training loss distribution by gradient descent.

Transductive Reward Inference on Graph

no code implementations6 Feb 2024 Bohao Qu, Xiaofeng Cao, Qing Guo, Yi Chang, Ivor W. Tsang, Chengqi Zhang

In this study, we present a transductive inference approach on that reward information propagation graph, which enables the effective estimation of rewards for unlabelled data in offline reinforcement learning.

reinforcement-learning

Source-Free Unsupervised Domain Adaptation with Hypothesis Consolidation of Prediction Rationale

1 code implementation2 Feb 2024 Yangyang Shu, Xiaofeng Cao, Qi Chen, BoWen Zhang, Ziqin Zhou, Anton Van Den Hengel, Lingqiao Liu

Source-Free Unsupervised Domain Adaptation (SFUDA) is a challenging task where a model needs to be adapted to a new domain without access to target domain labels or source domain data.

Unsupervised Domain Adaptation

A First-Order Multi-Gradient Algorithm for Multi-Objective Bi-Level Optimization

no code implementations17 Jan 2024 Feiyang Ye, Baijiong Lin, Xiaofeng Cao, Yu Zhang, Ivor Tsang

In this paper, we study the Multi-Objective Bi-Level Optimization (MOBLO) problem, where the upper-level subproblem is a multi-objective optimization problem and the lower-level subproblem is for scalar optimization.

Multi-Task Learning

Aggregation Weighting of Federated Learning via Generalization Bound Estimation

no code implementations10 Nov 2023 Mingwei Xu, Xiaofeng Cao, Ivor W. Tsang, James T. Kwok

In this paper, we replace the aforementioned weighting method with a new strategy that considers the generalization bounds of each local model.

Federated Learning Generalization Bounds

DualMatch: Robust Semi-Supervised Learning with Dual-Level Interaction

1 code implementation25 Oct 2023 Cong Wang, Xiaofeng Cao, Lanzhe Guo2, Zenglin Shi

In this paper, we propose a novel SSL method called DualMatch, in which the class prediction jointly invokes feature embedding in a dual-level interaction manner.

Data Augmentation

IRAD: Implicit Representation-driven Image Resampling against Adversarial Attacks

1 code implementation18 Oct 2023 Yue Cao, Tianlin Li, Xiaofeng Cao, Ivor Tsang, Yang Liu, Qing Guo

The underlying rationale behind our idea is that image resampling can alleviate the influence of adversarial perturbations while preserving essential semantic information, thereby conferring an inherent advantage in defending against adversarial attacks.

Adversarial Robustness

Nonparametric Iterative Machine Teaching

1 code implementation5 Jun 2023 Chen Zhang, Xiaofeng Cao, Weiyang Liu, Ivor Tsang, James Kwok

In this paper, we consider the problem of Iterative Machine Teaching (IMT), where the teacher provides examples to the learner iteratively such that the learner can achieve fast convergence to a target model.

Policy Dispersion in Non-Markovian Environment

no code implementations28 Feb 2023 Bohao Qu, Xiaofeng Cao, Jielong Yang, Hechang Chen, Chang Yi, Ivor W. Tsang, Yew-Soon Ong

To resolve this problem, this paper tries to learn the diverse policies from the history of state-action pairs under a non-Markovian environment, in which a policy dispersion scheme is designed for seeking diverse policy representation.

One-shot Machine Teaching: Cost Very Few Examples to Converge Faster

no code implementations13 Dec 2022 Chen Zhang, Xiaofeng Cao, Yi Chang, Ivor W Tsang

Then, relying on the surjective mapping from the teaching set to the parameter, we develop a design strategy of the optimal teaching set under appropriate settings, of which two popular efficiency metrics, teaching dimension and iterative teaching dimension are one.

A Survey of Learning on Small Data: Generalization, Optimization, and Challenge

no code implementations29 Jul 2022 Xiaofeng Cao, Weixin Bu, Shengjun Huang, MinLing Zhang, Ivor W. Tsang, Yew Soon Ong, James T. Kwok

In future, learning on small data that approximates the generalization ability of big data is one of the ultimate purposes of AI, which requires machines to recognize objectives and scenarios relying on small data as humans.

Active Learning Contrastive Learning +4

Data-Efficient Learning via Minimizing Hyperspherical Energy

no code implementations30 Jun 2022 Xiaofeng Cao, Weiyang Liu, Ivor W. Tsang

Finally, we demonstrate the empirical performance of MHEAL in a wide range of applications on data-efficient learning, including deep clustering, distribution matching, version space sampling and deep active learning.

Active Learning Deep Clustering

Black-box Generalization of Machine Teaching

no code implementations30 Jun 2022 Xiaofeng Cao, Yaming Guo, Ivor W. Tsang, James T. Kwok

An inherent assumption is that this learning manner can derive those updates into the optimal hypothesis.

Active Learning

Hyperbolic Uncertainty Aware Semantic Segmentation

no code implementations16 Mar 2022 Bike Chen, Wei Peng, Xiaofeng Cao, Juha Röning

Semantic segmentation (SS) aims to classify each pixel into one of the pre-defined classes.

Segmentation Self-Driving Cars +1

Distribution Matching for Machine Teaching

no code implementations6 May 2021 Xiaofeng Cao, Ivor W. Tsang

This optimization solver is in general ineffective when the student learner does not disclose any cue of the learning parameters.

Bayesian Active Learning by Disagreements: A Geometric Perspective

no code implementations6 May 2021 Xiaofeng Cao, Ivor W. Tsang

We present geometric Bayesian active learning by disagreements (GBALD), a framework that performs BALD on its core-set construction interacting with model uncertainty estimation.

Active Learning

On the Geometry of Deep Bayesian Active Learning

no code implementations1 Jan 2021 Xiaofeng Cao, Ivor Tsang

To guarantee the improvements, our generalization analysis proves that, compared to typical Bayesian spherical interpretation, geodesic search with ellipsoid can derive a tighter lower error bound and achieve higher probability to obtain a nearly zero error.

Active Learning

Learning Image-Specific Attributes by Hyperbolic Neighborhood Graph Propagation

no code implementations20 May 2019 Xiaofeng Xu, Ivor W. Tsang, Xiaofeng Cao, Ruiheng Zhang, Chuancai Liu

In most of existing attribute-based research, class-specific attributes (CSA), which are class-level annotations, are usually adopted due to its low annotation cost for each class instead of each individual image.

Attribute

Target-Independent Active Learning via Distribution-Splitting

no code implementations28 Sep 2018 Xiaofeng Cao, Ivor W. Tsang, Xiaofeng Xu, Guandong Xu

By discovering the connections between hypothesis and input distribution, we map the volume of version space into the number density and propose a target-independent distribution-splitting strategy with the following advantages: 1) provide theoretical guarantees on reducing label complexity and error rate as volume-splitting; 2) break the curse of initial hypothesis; 3) provide model guidance for a target-independent AL algorithm in real AL tasks.

Active Learning

A Structured Perspective of Volumes on Active Learning

no code implementations24 Jul 2018 Xiaofeng Cao, Ivor W. Tsang, Guandong Xu

In this paper, we approximate the version space to a structured {hypersphere} that covers most of the hypotheses, and then divide the available AL sampling approaches into two kinds of strategies: Outer Volume Sampling and Inner Volume Sampling.

Active Learning

A Divide-and-Conquer Approach to Geometric Sampling for Active Learning

no code implementations31 May 2018 Xiaofeng Cao

With the advantages of cluster boundary points in the above two properties, we propose a Geometric Active Learning (GAL) algorithm by knight's tour.

Active Learning Boundary Detection +1

Cannot find the paper you are looking for? You can Submit a new open access paper.