no code implementations • 22 Oct 2024 • Jonathan Light, Yue Wu, Yiyou Sun, Wenchao Yu, Yanchi Liu, Xujiang Zhao, Ziniu Hu, Haifeng Chen, Wei Cheng
We propose a novel approach to scaling LLM inference for code generation.
1 code implementation • 14 Aug 2024 • Xiaogen Zhou, Yiyou Sun, Min Deng, Winnie Chiu Wing Chu, Qi Dou
With a channel-wise semantic consistency loss, our framework ensures alignment of modality-independent information from a feature-wise perspective across modalities, thereby fortifying it against misalignments in multimodal scenarios.
1 code implementation • 7 Jun 2024 • Cong Zeng, Shengkun Tang, Xianjun Yang, Yuanzhou Chen, Yiyou Sun, Zhiqiang Xu, Yao Li, Haifeng Chen, Wei Cheng, Dongkuan Xu
However, these methods grapple with the misalignment between the distributions of the surrogate and the often undisclosed target models, leading to performance degradation, particularly with the introduction of new, closed-source models.
1 code implementation • 28 May 2024 • Xuefeng Du, Yiyou Sun, Yixuan Li
We employ a graph-theoretic approach, rigorously analyzing the separability of ID data from OOD data in a closed-form manner.
1 code implementation • 15 Feb 2024 • Chen Ling, Xujiang Zhao, Xuchao Zhang, Wei Cheng, Yanchi Liu, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Jie Ji, Guangji Bai, Liang Zhao, Haifeng Chen
Existing works have been devoted to quantifying the uncertainty in LLM's response, but they often overlook the complex nature of LLMs and the uniqueness of in-context learning.
no code implementations • 6 Feb 2024 • Yiyou Sun, Junjie Hu, Wei Cheng, Haifeng Chen
This paper introduces the retrieval-augmented large language model with Definite Finite Automaton (DFA-RAG), a novel framework designed to enhance the capabilities of conversational agents using large language models (LLMs).
no code implementations • 22 Dec 2023 • Soumya Suvra Ghosal, Yiyou Sun, Yixuan Li
Subspace learning yields highly distinguishable distance measures between ID and OOD data.
1 code implementation • NeurIPS 2023 • Yiyou Sun, Zhenmei Shi, Yixuan Li
Open-world semi-supervised learning aims at inferring both known and novel classes in unlabeled data, by harnessing prior knowledge from a labeled set with known classes.
no code implementations • 10 Oct 2023 • Yiyou Sun
Moving beyond OOD detection, ORL extends the capabilities of the model to not only detect unknown instances but also learn from and incorporate knowledge about these new classes.
1 code implementation • NeurIPS 2023 • Xuefeng Du, Yiyou Sun, Xiaojin Zhu, Yixuan Li
Utilizing auxiliary outlier datasets to regularize the machine learning model has demonstrated promise for out-of-distribution (OOD) detection and safe prediction.
1 code implementation • 9 Aug 2023 • Yiyou Sun, Zhenmei Shi, YIngyu Liang, Yixuan Li
This paper bridges the gap by providing an analytical framework to formalize and investigate when and how known classes can help discover novel classes.
2 code implementations • 15 Jun 2023 • Jingyang Zhang, Jingkang Yang, Pengyun Wang, Haoqi Wang, Yueqian Lin, Haoran Zhang, Yiyou Sun, Xuefeng Du, Yixuan Li, Ziwei Liu, Yiran Chen, Hai Li
Out-of-Distribution (OOD) detection is critical for the reliable operation of open-world intelligent systems.
Out-of-Distribution Detection Out of Distribution (OOD) Detection
1 code implementation • CVPR 2023 • Yiyou Sun, Yaojie Liu, Xiaoming Liu, Yixuan Li, Wen-Sheng Chu
This work studies the generalization issue of face anti-spoofing (FAS) models on domain gaps, such as image resolution, blurriness and sensor variations.
2 code implementations • 24 Nov 2022 • Yifei Ming, Ziyang Cai, Jiuxiang Gu, Yiyou Sun, Wei Li, Yixuan Li
Recognizing out-of-distribution (OOD) samples is critical for machine learning systems deployed in the open world.
4 code implementations • 13 Oct 2022 • Jingkang Yang, Pengyun Wang, Dejian Zou, Zitang Zhou, Kunyuan Ding, Wenxuan Peng, Haoqi Wang, Guangyao Chen, Bo Li, Yiyou Sun, Xuefeng Du, Kaiyang Zhou, Wayne Zhang, Dan Hendrycks, Yixuan Li, Ziwei Liu
Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature.
1 code implementation • 4 Aug 2022 • Yiyou Sun, Yixuan Li
Machine learning models deployed in the wild naturally encounter unlabeled samples from both known and novel classes.
2 code implementations • 13 Apr 2022 • Yiyou Sun, Yifei Ming, Xiaojin Zhu, Yixuan Li
In this paper, we explore the efficacy of non-parametric nearest-neighbor distance for OOD detection, which has been largely overlooked in the literature.
1 code implementation • 8 Mar 2022 • Yifei Ming, Yiyou Sun, Ousmane Dia, Yixuan Li
Out-of-distribution (OOD) detection is a critical task for reliable machine learning.
Out-of-Distribution Detection Out of Distribution (OOD) Detection +1
1 code implementation • NeurIPS 2021 • Yiyou Sun, Chuan Guo, Yixuan Li
Out-of-distribution (OOD) detection has received much attention lately due to its practical importance in enhancing the safe deployment of neural networks.
Ranked #13 on Out-of-Distribution Detection on ImageNet-1k vs SUN
1 code implementation • 18 Nov 2021 • Yiyou Sun, Yixuan Li
Detecting out-of-distribution (OOD) inputs is a central challenge for safely deploying machine learning models in the real world.
Ranked #4 on Out-of-Distribution Detection on ImageNet-1k vs SUN
no code implementations • 29 Sep 2021 • Yiyou Sun, Sharon Li
Detecting out-of-distribution (OOD) inputs is a central challenge for safely deploying machine learning models in the real world.
no code implementations • ICCV 2019 • Yiyou Sun, Sathya N. Ravi, Vikas Singh
In this paper, we show how a simple modification of the SGD scheme can help provide dynamic/EM routing type behavior in convolutional neural networks.
1 code implementation • ECCV 2018 • Bolei Zhou, Yiyou Sun, David Bau, Antonio Torralba
Explanations of the decisions made by a deep neural network are important for human end-users to be able to understand and diagnose the trustworthiness of the system.
no code implementations • 7 Jun 2018 • Bolei Zhou, Yiyou Sun, David Bau, Antonio Torralba
We confirm that unit attributes such as class selectivity are a poor predictor for impact on overall accuracy as found previously in recent work \cite{morcos2018importance}.