Search Results for author: Shuntaro Takahashi

Found 4 papers, 0 papers with code

Evaluating Computational Language Models with Scaling Properties of Natural Language

no code implementations CL 2019 Shuntaro Takahashi, Kumiko Tanaka-Ishii

Statistical mechanical analyses have revealed that natural language text is characterized by scaling properties, which quantify the global structure in the vocabulary population and the long memory of a text.

Text Generation

Assessing Language Models with Scaling Properties

no code implementations24 Apr 2018 Shuntaro Takahashi, Kumiko Tanaka-Ishii

Five such tests are considered, with the first two accounting for the vocabulary population and the other three for the long memory of natural language.

Do Neural Nets Learn Statistical Laws behind Natural Language?

no code implementations16 Jul 2017 Shuntaro Takahashi, Kumiko Tanaka-Ishii

Precisely, we demonstrate that a neural language model based on long short-term memory (LSTM) effectively reproduces Zipf's law and Heaps' law, two representative statistical properties underlying natural language.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.