Beyond Film Subtitles: Is YouTube the Best Approximation of Spoken Vocabulary?

1 code implementation • 4 Oct 2024 • Adam Nohejl, Frederikus Hudi, Eunike Andriani Kardinata, Shintaro Ozaki, Maria Angelica Riera Machin, Hongyu Sun, Justin Vasselli, Taro Watanabe

Word frequency is a key variable in psycholinguistics, useful for modeling human familiarity with words even in the era of large language models (LLMs).

Lexical Complexity Prediction Word Embeddings