Search Results for author: Govardana Sachitanandam Ramachandran

Found 1 papers, 1 papers with code

Mirostat: A Neural Text Decoding Algorithm that Directly Controls Perplexity

2 code implementations ICLR 2021 Sourya Basu, Govardana Sachitanandam Ramachandran, Nitish Shirish Keskar, Lav R. Varshney

Experiments show that for low values of k and p in top-k and top-p sampling, perplexity drops significantly with generated text length, which is also correlated with excessive repetitions in the text (the boredom trap).

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.