Search Results for author:
Found 15 papers, 9 papers with code
Meta Self-Refinement for Robust Learning with Weak Supervision
However, labels from weak supervision can be rather noisy and the high capacity of DNNs makes them easy to overfit the noisy labels.
MCSE: Multimodal Contrastive Learning of Sentence Embeddings
Learning semantically meaningful sentence embeddings is an open problem in natural language processing.
Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification
Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision.
Proceedings of the First Workshop on Weakly Supervised Learning (WeaSuL)
Welcome to WeaSuL 2021, the First Workshop on Weakly Supervised Learning, co-located with ICLR 2021.
ANEA: Distant Supervision for Low-Resource Named Entity Recognition
Distant supervision allows obtaining labeled training corpora for low-resource settings where only limited hand-annotated data exists.
Low Resource Named Entity Recognition
Named Entity Recognition
Analysing the Noise Model Error for Realistic Noisy Label Data
Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors.
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios
Deep neural networks and huge language models are becoming omnipresent in natural language applications.
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages
Multilingual transformer models like mBERT and XLM-RoBERTa have obtained great improvements for many NLP tasks on a variety of languages.
On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers
Our analysis reveals that while fine-tuning indeed changes the representations of a pre-trained model and these changes are typically larger for higher layers, only in very few cases, fine-tuning has a positive effect on probing accuracy that is larger than just using the pre-trained model with a strong pooling method.
Learning Functions to Study the Benefit of Multitask Learning
Although multitask learning has achieved improved performance in some problems, there are also tasks that lose performance when trained together.
Distant Supervision and Noisy Label Learning for Low Resource Named Entity Recognition: A Study on Hausa and Yorùbá
Techniques such as distant and weak supervision can be used to create labeled data in a (semi-) automatic way.
Low Resource Named Entity Recognition
Named Entity Recognition
+1
Feature-Dependent Confusion Matrices for Low-Resource NER Labeling with Noisy Labels
In low-resource settings, the performance of supervised labeling models can be improved with automatically annotated or distantly supervised data, which is cheap to create but often noisy.
Low Resource Named Entity Recognition
Named Entity Recognition
+3
Using Multi-Sense Vector Embeddings for Reverse Dictionaries
However, they typically cannot serve as a drop-in replacement for conventional single-sense embeddings, because the correct sense vector needs to be selected for each word.
Handling Noisy Labels for Robustly Learning from Self-Training Data for Low-Resource Sequence Labeling
In our experiments on Chunking and NER, this approach performs more robustly than the baselines.
Training a Neural Network in a Low-Resource Setting on Automatically Annotated Noisy Data
Manually labeled corpora are expensive to create and often not available for low-resource languages or domains.
