no code implementations • 26 Nov 2020 • Jihyeon Roh, Sang-Hoon Oh, Soo-Young Lee
Although Perplexity is a widely used performance metric for language models, the values are highly dependent upon the number of words in the corpus and is useful to compare performance of the same corpus only.
no code implementations • 18 Sep 2020 • Jihyeon Roh, Huiseong Gim, Soo-Young Lee
First, we propose a hierarchical GPT which consists of three blocks, i. e., a sentence encoding block, a sentence generating block, and a sentence decoding block.