BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Models

2 code implementations • 12 Sep 2023 • Wei Qi Leong, Jian Gang Ngui, Yosephine Susanto, Hamsawardhini Rengarajan, Kengatharaiyer Sarveswaran, William Chandra Tjhi

As GPT-4 is purportedly one of the best-performing multilingual LLMs at the moment, we use it as a yardstick to gauge the capabilities of LLMs in the context of SEA languages.

Natural Language Understanding