Search Results for author: Yingyi Chen

Found 10 papers, 5 papers with code

SURE: SUrvey REcipes for building reliable and robust deep networks

1 code implementation1 Mar 2024 Yuting Li, Yingyi Chen, Xuanlong Yu, Dexiong Chen, Xi Shen

In this paper, we revisit techniques for uncertainty estimation within deep neural networks and consolidate a suite of techniques to enhance their reliability.

Learning with noisy labels Long-tail Learning

Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes

no code implementations2 Feb 2024 Yingyi Chen, Qinghua Tao, Francesco Tonin, Johan A. K. Suykens

In this work, we propose Kernel-Eigen Pair Sparse Variational Gaussian Processes (KEP-SVGP) for building uncertainty-aware self-attention where the asymmetry of attention kernels is tackled by Kernel SVD (KSVD) and a reduced complexity is acquired.

Gaussian Processes Variational Inference

Primal-Attention: Self-attention through Asymmetric Kernel SVD in Primal Representation

1 code implementation NeurIPS 2023 Yingyi Chen, Qinghua Tao, Francesco Tonin, Johan A. K. Suykens

To the best of our knowledge, this is the first work that provides a primal-dual representation for the asymmetric kernel in self-attention and successfully applies it to modeling and optimization.

D4RL Long-range modeling +2

Jigsaw-ViT: Learning Jigsaw Puzzles in Vision Transformer

1 code implementation25 Jul 2022 Yingyi Chen, Xi Shen, Yahui Liu, Qinghua Tao, Johan A. K. Suykens

In this paper, we explore solving jigsaw puzzle as a self-supervised auxiliary loss in ViT for image classification, named Jigsaw-ViT.

Classification Domain Generalization +2

Compressing Features for Learning with Noisy Labels

1 code implementation27 Jun 2022 Yingyi Chen, Shell Xu Hu, Xi Shen, Chunrong Ai, Johan A. K. Suykens

This decomposition provides three insights: (i) it shows that over-fitting is indeed an issue for learning with noisy labels; (ii) through an information bottleneck formulation, it explains why the proposed feature compression helps in combating label noise; (iii) it gives explanations on the performance boost brought by incorporating compression regularization into Co-teaching.

Ranked #10 on Image Classification on Clothing1M (using extra training data)

Feature Compression Feature Importance +2

Boosting Co-teaching with Compression Regularization for Label Noise

1 code implementation28 Apr 2021 Yingyi Chen, Xi Shen, Shell Xu Hu, Johan A. K. Suykens

On Clothing1M, our approach obtains 74. 9% accuracy which is slightly better than that of DivideMix.

Ranked #12 on Image Classification on Clothing1M (using extra training data)

Data Compression Learning with noisy labels +1

Fast Learning in Reproducing Kernel Krein Spaces via Signed Measures

no code implementations30 May 2020 Fanghui Liu, Xiaolin Huang, Yingyi Chen, Johan A. K. Suykens

In this paper, we attempt to solve a long-lasting open question for non-positive definite (non-PD) kernels in machine learning community: can a given non-PD kernel be decomposed into the difference of two PD kernels (termed as positive decomposition)?

Open-Ended Question Answering

Two-stage Best-scored Random Forest for Large-scale Regression

no code implementations9 May 2019 Hanyuan Hang, Yingyi Chen, Johan A. K. Suykens

We propose a novel method designed for large-scale regression problems, namely the two-stage best-scored random forest (TBRF).

Computational Efficiency Ensemble Learning +2

DSTP-RNN: a dual-stage two-phase attention-based recurrent neural networks for long-term and multivariate time series prediction

no code implementations16 Apr 2019 Yeqi Liu, Chuanyang Gong, Ling Yang, Yingyi Chen

The key to solve this problem is to capture the spatial correlations at the same time, the spatio-temporal relationships at different times and the long-term dependence of the temporal relationships between different series.

Time Series Time Series Prediction

Real time expert system for anomaly detection of aerators based on computer vision technology and existing surveillance cameras

no code implementations9 Oct 2018 Yeqi Liu, Yingyi Chen, Huihui Yu, Xiaomin Fang, Chuanyang Gong

To tackle these aforementioned challenges, we propose a real-time expert system based on computer vision technology and existing surveillance cameras for anomaly detection of aerators, which consists of two modules, i. e., object region detection and working state detection.

Anomaly Detection Cultural Vocal Bursts Intensity Prediction +4

Cannot find the paper you are looking for? You can Submit a new open access paper.