Homonym normalisation by word sense clustering: a case in Japanese

no code implementations • COLING 2020 • Yo Sato, Kevin Heffernan

This work presents a method of word sense clustering that differentiates homonyms and merge homophones, taking Japanese as an example, where orthographical variation causes problem for language processing.

Clustering Language Modelling +1

Dialect Clustering with Character-Based Metrics: in Search of the Boundary of Language and Dialect

no code implementations • LREC 2020 • Yo Sato, Kevin Heffernan

We present in this work a universal, character-based method for representing sentences so that one can thereby calculate the distance between any two sentence pair.

Clustering Sentence

Creating dialect sub-corpora by clustering: a case in Japanese for an adaptive method

no code implementations • LREC 2018 • Yo Sato, Kevin Heffernan

Clustering Language Modelling