Search Results for author: Kristjan Arumae

Found 10 papers, 2 papers with code

Kronecker Factorization for Preventing Catastrophic Forgetting in Large-scale Medical Entity Linking

no code implementations11 Nov 2021 Denis Jered McInerney, Luyang Kong, Kristjan Arumae, Byron Wallace, Parminder Bhatia

Elastic Weight Consolidation is a recently proposed method to address this issue, but scaling this approach to the modern large models used in practice requires making strong independence assumptions about model parameters, limiting its effectiveness.

Entity Linking Multi-Task Learning

An Empirical Investigation Towards Efficient Multi-Domain Language Model Pre-training

1 code implementation EMNLP 2020 Kristjan Arumae, Qing Sun, Parminder Bhatia

However, in order to achieve state-of-the-art performance on out of domain tasks such as clinical named entity recognition and relation extraction, additional in domain pre-training is required.

Clustering Language Modelling +4

CALM: Continuous Adaptive Learning for Language Modeling

no code implementations8 Apr 2020 Kristjan Arumae, Parminder Bhatia

Training large language representation models has become a standard in the natural language processing community.

Continual Learning Language Modelling

Dynamic Transfer Learning for Named Entity Recognition

no code implementations13 Dec 2018 Parminder Bhatia, Kristjan Arumae, Busra Celikkaya

We complement a standard hierarchical NER model with a general transfer learning framework consisting of parameter sharing between the source and target tasks, and showcase scores significantly above the baseline architecture.

Model Optimization named-entity-recognition +3

Reinforced Extractive Summarization with Question-Focused Rewards

no code implementations ACL 2018 Kristjan Arumae, Fei Liu

We use reinforcement learning to explore the space of possible extractive summaries and introduce a question-focused reward function to promote concise, fluent, and informative summaries.

Extractive Summarization reinforcement-learning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.