Demystify Self-Attention in Vision Transformers from a Semantic Perspective: Analysis and Application

no code implementations • 13 Nov 2022 • Leijie Wu, Song Guo, Yaohong Ding, Junxiao Wang, Wenchao Xu, Richard Yida Xu, Jie Zhang

In contrast, visual data exhibits a fundamentally different structure: Its basic unit (pixel) is a natural low-level representation with significant redundancies in the neighbourhood, which poses obvious challenges to the interpretability of MSA mechanism in ViT.

Boundary Aware Learning for Out-of-distribution Detection

no code implementations • 22 Dec 2021 • Sen Pei, Xin Zhang, Richard Yida Xu, Gaofeng Meng

This paper focuses on the problem of detecting out-of-distribution (ood) samples with neural nets.

Out-of-Distribution Detection Out of Distribution (OOD) Detection

Unsupervised clothing change adaptive person ReID

no code implementations • 8 Sep 2021 • Ziyue Zhang, Shuai Jiang, Congzhentao Huang, Richard Yida Xu

We developer a purely unsupervised clothing change person ReID pipeline with person sync augmentation operation and same person feature restriction.

Diversified Hidden Markov Models for Sequential Labeling

no code implementations • 5 Apr 2019 • Maoying Qiao, Wei Bian, Richard Yida Xu, DaCheng Tao

While the first-order Hidden Markov Models (HMM) provides a fundamental approach for unsupervised sequential labeling, the basic model does not show satisfying performance when it is directly applied to real world problems, such as part-of-speech tagging (PoS tagging) and optical character recognition (OCR).

Optical Character Recognition Optical Character Recognition (OCR) +3

Relative Pairwise Relationship Constrained Non-negative Matrix Factorisation

1 code implementation • 5 Mar 2018 • Shuai Jiang, Kan Li, Richard Yida Xu

Non-negative Matrix Factorisation (NMF) has been extensively used in machine learning and data analytics applications.

Clustering Image Clustering +1