Search Results for author:
Found 8 papers, 2 papers with code
Learning from Missing Relations: Contrastive Learning with Commonsense Knowledge Graphs for Commonsense Inference
Commonsense inference poses a unique challenge to reason and generate the physical, social, and causal conditions of a given event.
KOAS: Korean Text Offensiveness Analysis System
Warning: This manuscript contains a certain level of offensive expression.
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking
Masked language modeling (MLM) has been widely used for pre-training effective bidirectional representations, but incurs substantial training costs.
Multi-pretraining for Large-scale Text Classification
In addition, we propose a weakly supervised pretraining, where labels for text classification are obtained automatically from an existing approach.
Adaptive Compression of Word Embeddings
However, unlike prior works that assign the same length of codes to all words, we adaptively assign different lengths of codes to each word by learning downstream tasks.
Representation Learning for Unseen Words by Bridging Subwords to Semantic Networks
In the first stage, we learn subword embeddings from the pre-trained word embeddings by using an additive composition function of subwords.
Learning to Generate Word Representations using Subword Information
Unlike previous models that learn word representations from a large corpus, we take a set of pre-trained word embeddings and generalize it to word entries, including OOV words.
Incorporating Word Embeddings into Open Directory Project based Large-scale Classification
However, these approaches are limited to small- or moderate-scale text classification.
