Search Results for author:
Found 8 papers, 3 papers with code
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining
Here, we introduce MosaicBERT, a BERT-style encoder architecture and training recipe that is empirically optimized for fast pretraining.
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics.
Ranked #1 on
Extreme Summarization
on GEM-XSum
Abstractive Text Summarization
Cross-Lingual Abstractive Summarization
+5
A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation
On the other hand, we find that the set of sampling algorithms that satisfies these properties performs on par with the existing sampling algorithms.
StereoSet: Measuring stereotypical bias in pretrained language models
Since pretrained language models are trained on large real world data, they are known to capture stereotypical biases.
Ranked #1 on
Bias Detection
on StereoSet
Neural Multi-Task Learning for Stance Prediction
We present a multi-task learning model that leverages large amount of textual information from existing datasets to improve stance prediction.
FAKTA: An Automatic End-to-End Fact Checking System
We present FAKTA which is a unified framework that integrates various components of a fact checking process: document retrieval from media sources with various types of reliability, stance detection of documents with respect to given claims, evidence extraction, and linguistic analysis.
Context-Aware Systems for Sequential Item Recommendation
We achieved an R^2 score of 0. 81 in the content embedding space, and a recall score of 54% on our 100 nearest neighbors.
Identifying Depression on Twitter
Social media has recently emerged as a premier method to disseminate information online.
