Search Results for author: Xuefeng Du

Found 19 papers, 12 papers with code

How Does Unlabeled Data Provably Help Out-of-Distribution Detection?

1 code implementation5 Feb 2024 Xuefeng Du, Zhen Fang, Ilias Diakonikolas, Yixuan Li

Harnessing the power of unlabeled in-the-wild data is non-trivial due to the heterogeneity of both in-distribution (ID) and OOD data.

Out-of-Distribution Detection

Dream the Impossible: Outlier Imagination with Diffusion Models

1 code implementation NeurIPS 2023 Xuefeng Du, Yiyou Sun, Xiaojin Zhu, Yixuan Li

Utilizing auxiliary outlier datasets to regularize the machine learning model has demonstrated promise for out-of-distribution (OOD) detection and safe prediction.

Out of Distribution (OOD) Detection

Feed Two Birds with One Scone: Exploiting Wild Data for Both Out-of-Distribution Generalization and Detection

no code implementations15 Jun 2023 Haoyue Bai, Gregory Canal, Xuefeng Du, Jeongyeol Kwon, Robert Nowak, Yixuan Li

Modern machine learning models deployed in the wild can encounter both covariate and semantic shifts, giving rise to the problems of out-of-distribution (OOD) generalization and OOD detection respectively.

Out-of-Distribution Generalization

Non-Parametric Outlier Synthesis

1 code implementation6 Mar 2023 Leitian Tao, Xuefeng Du, Xiaojin Zhu, Yixuan Li

Importantly, our proposed synthesis approach does not make any distributional assumption on the ID embeddings, thereby offering strong flexibility and generality.

Out-of-Distribution Detection

OpenOOD: Benchmarking Generalized Out-of-Distribution Detection

3 code implementations13 Oct 2022 Jingkang Yang, Pengyun Wang, Dejian Zou, Zitang Zhou, Kunyuan Ding, Wenxuan Peng, Haoqi Wang, Guangyao Chen, Bo Li, Yiyou Sun, Xuefeng Du, Kaiyang Zhou, Wayne Zhang, Dan Hendrycks, Yixuan Li, Ziwei Liu

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature.

Anomaly Detection Benchmarking +3

VOS: Learning What You Don't Know by Virtual Outlier Synthesis

1 code implementation2 Feb 2022 Xuefeng Du, Zhaoning Wang, Mu Cai, Yixuan Li

In this paper, we present VOS, a novel framework for OOD detection by adaptively synthesizing virtual outliers that can meaningfully regularize the model's decision boundary during training.

object-detection Object Detection +1

Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search

no code implementations CVPR 2022 Pengtao Xie, Xuefeng Du

In existing MKD methods, mutual knowledge distillation is performed between models without scrutiny: a worse-performing model is allowed to generate knowledge to train a better-performing model, which may lead to collective failures.

Knowledge Distillation Neural Architecture Search

PI-GNN: Towards Robust Semi-Supervised Node Classification against Noisy Labels

no code implementations29 Sep 2021 Xuefeng Du, Tian Bian, Yu Rong, Bo Han, Tongliang Liu, Tingyang Xu, Wenbing Huang, Junzhou Huang

Semi-supervised node classification on graphs is a fundamental problem in graph mining that uses a small set of labeled nodes and many unlabeled nodes for training, so that its performance is quite sensitive to the quality of the node labels.

Graph Mining Node Classification

Towards Unknown-aware Learning with Virtual Outlier Synthesis

no code implementations ICLR 2022 Xuefeng Du, Zhaoning Wang, Mu Cai, Yixuan Li

In this paper, we present VOS, a novel framework for OOD detection by adaptively synthesizing virtual outliers that can meaningfully regularize the model's decision boundary during training.

object-detection Object Detection +1

Noise-robust Graph Learning by Estimating and Leveraging Pairwise Interactions

1 code implementation14 Jun 2021 Xuefeng Du, Tian Bian, Yu Rong, Bo Han, Tongliang Liu, Tingyang Xu, Wenbing Huang, Yixuan Li, Junzhou Huang

This paper bridges the gap by proposing a pairwise framework for noisy node classification on graphs, which relies on the PI as a primary learning proxy in addition to the pointwise learning from the noisy node class labels.

Contrastive Learning Graph Learning +2

Learning Diverse-Structured Networks for Adversarial Robustness

1 code implementation3 Feb 2021 Xuefeng Du, Jingfeng Zhang, Bo Han, Tongliang Liu, Yu Rong, Gang Niu, Junzhou Huang, Masashi Sugiyama

In adversarial training (AT), the main focus has been the objective and optimizer while the model has been less studied, so that the models being used are still those classic ones in standard training (ST).

Adversarial Robustness

Small-Group Learning, with Application to Neural Architecture Search

1 code implementation23 Dec 2020 Xuefeng Du, Pengtao Xie

SGL is formulated as a multi-level optimization framework consisting of three learning stages: each learner trains a model independently and uses this model to perform pseudo-labeling; each learner trains another model using datasets pseudo-labeled by other learners; learners improve their architectures by minimizing validation losses.

Neural Architecture Search

Skillearn: Machine Learning Inspired by Humans' Learning Skills

no code implementations9 Dec 2020 Pengtao Xie, Xuefeng Du, Hao Ban

To achieve this goal, we develop a general framework -- Skillearn, which provides a principled way to represent humans' learning skills mathematically and use the formally-represented skills to improve the training of ML models.

BIG-bench Machine Learning Neural Architecture Search

Learning by Passing Tests, with Application to Neural Architecture Search

no code implementations30 Nov 2020 Xuefeng Du, Haochen Zhang, Pengtao Xie

We propose a multi-level optimization framework to formulate LPT, where the tester learns to create difficult and meaningful tests and the learner learns to pass these tests.

Neural Architecture Search

Node Classification on Graphs with Few-Shot Novel Labels via Meta Transformed Network Embedding

1 code implementation NeurIPS 2020 Lin Lan, Pinghui Wang, Xuefeng Du, Kaikai Song, Jing Tao, Xiaohong Guan

We study the problem of node classification on graphs with few-shot novel labels, which has two distinctive properties: (1) There are novel labels to emerge in the graph; (2) The novel labels have only a few representative nodes for training a classifier.

General Classification Graph structure learning +3

Towards Efficient Unconstrained Palmprint Recognition via Deep Distillation Hashing

1 code implementation7 Apr 2020 Huikai Shao, DEXING ZHONG, Xuefeng Du

Previous studies of palmprint recognition are mainly based on constrained datasets collected by dedicated devices in controlled environments, which has to reduce the flexibility and convenience.

Knowledge Distillation

Cannot find the paper you are looking for? You can Submit a new open access paper.