Adaptable Multi-Domain Language Model for Transformer ASR

no code implementations • 14 Aug 2020 • Taewoo Lee, Min-Joong Lee, Tae Gyoon Kang, Seokyeoung Jung, Minseok Kwon, Yeona Hong, Jungin Lee, Kyoung-Gu Woo, Ho-Gyeong Kim, Jiseung Jeong, Ji-Hyun Lee, Hosik Lee, Young Sang Choi

We propose an adapter based multi-domain Transformer based language model (LM) for Transformer ASR.

Domain Adaptation Language Modelling

KoBigBird-large: Transformation of Transformer for Korean Language Understanding

no code implementations • 19 Sep 2023 • Kisu Yang, Yoonna Jang, Taewoo Lee, Jinwoo Seong, Hyungjin Lee, Hwanseok Jang, Heuiseok Lim

This work presents KoBigBird-large, a large size of Korean BigBird that achieves state-of-the-art performance and allows long sequence processing for Korean language understanding.

Document Classification Question Answering