Improving Question Answering Performance Using Knowledge Distillation and Active Learning

1 code implementation • 26 Sep 2021 • Yasaman Boreshban, Seyed Morteza Mirbostani, Gholamreza Ghassem-Sani, Seyed Abolghasem Mirroshandel, Shahin Amiriparian

Contemporary question answering (QA) systems, including transformer-based architectures, suffer from increasing computational and model complexity which render them inefficient for real-world applications with limited resources.

Active Learning Knowledge Distillation +1