no code implementations • 3 Apr 2024 • Ashima Suvarna, Harshita Khandelwal, Nanyun Peng
To this end, we present PhonologyBench, a novel benchmark consisting of three diagnostic tasks designed to explicitly test the phonological skills of LLMs in English: grapheme-to-phoneme conversion, syllable counting, and rhyme word generation.