TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learning

14 Apr 2021 Kexin Wang Nils Reimers Iryna Gurevych

Learning sentence embeddings often requires large amount of labeled data. However, for most tasks and domains, labeled data is seldom available and creating it is expensive... (read more)

PDF Abstract

Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Re-Ranking AskUbuntu TSDAE MAP 59.4 # 1
Information Retrieval CQADupStack TSDAE mAP@100 14.5 # 1
Paraphrase Identification PIT TSDAE AP 69.2 # 1
Re-Ranking SciDocs TSDAE Cite 71.4 # 1
CC 73.9 # 1
CR 75.0 # 1
CV 75.6 # 1
Paraphrase Identification TURL TSDAE AP 76.8 # 1

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet