no code implementations • 11 Nov 2021 • Denis Jered McInerney, Luyang Kong, Kristjan Arumae, Byron Wallace, Parminder Bhatia
Elastic Weight Consolidation is a recently proposed method to address this issue, but scaling this approach to the modern large models used in practice requires making strong independence assumptions about model parameters, limiting its effectiveness.
1 code implementation • EMNLP 2020 • Kristjan Arumae, Qing Sun, Parminder Bhatia
However, in order to achieve state-of-the-art performance on out of domain tasks such as clinical named entity recognition and relation extraction, additional in domain pre-training is required.
no code implementations • 17 Jul 2020 • Parminder Bhatia, Lan Liu, Kristjan Arumae, Nima Pourdamghani, Suyog Deshpande, Ben Snively, Mona Mona, Colby Wise, George Price, Shyam Ramaswamy, Xiaofei Ma, Ramesh Nallapati, Zhiheng Huang, Bing Xiang, Taha Kass-Hout
Coronavirus disease (COVID-19) has been declared as a pandemic by WHO with thousands of cases being reported each day.
no code implementations • 8 Apr 2020 • Kristjan Arumae, Parminder Bhatia
Training large language representation models has become a standard in the natural language processing community.
no code implementations • WS 2019 • Kristjan Arumae, Parminder Bhatia, Fei Liu
Highlighting is a powerful tool to pick out important content and emphasize.
no code implementations • 17 Oct 2019 • Kristjan Arumae, Parminder Bhatia, Fei Liu
Highlighting is a powerful tool to pick out important content and emphasize.
1 code implementation • NAACL 2019 • Kristjan Arumae, Fei Liu
However, a major obstacle to the development of a supervised summarizer is the lack of ground-truth.
no code implementations • 13 Dec 2018 • Parminder Bhatia, Kristjan Arumae, Busra Celikkaya
We complement a standard hierarchical NER model with a general transfer learning framework consisting of parameter sharing between the source and target tasks, and showcase scores significantly above the baseline architecture.
no code implementations • 25 May 2018 • Kristjan Arumae, Guo-Jun Qi, Fei Liu
Asking effective questions is a powerful social skill.
no code implementations • ACL 2018 • Kristjan Arumae, Fei Liu
We use reinforcement learning to explore the space of possible extractive summaries and introduce a question-focused reward function to promote concise, fluent, and informative summaries.