Continual Learning with Knowledge Transfer for Sentiment Classification

18 Dec 2021  ·  Zixuan Ke, Bing Liu, Hao Wang, Lei Shu ·

This paper studies continual learning (CL) for sentiment classification (SC). In this setting, the CL system learns a sequence of SC tasks incrementally in a neural network, where each task builds a classifier to classify the sentiment of reviews of a particular product category or domain. Two natural questions are: Can the system transfer the knowledge learned in the past from the previous tasks to the new task to help it learn a better model for the new task? And, can old models for previous tasks be improved in the process as well? This paper proposes a novel technique called KAN to achieve these objectives. KAN can markedly improve the SC accuracy of both the new task and the old tasks via forward and backward knowledge transfer. The effectiveness of KAN is demonstrated through extensive experiments.

PDF Abstract

Datasets


Introduced in the Paper:

DSC (10 tasks)

Used in the Paper:

ASC (TIL, 19 tasks)

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Continual Learning ASC (19 tasks) KAN F1 - macro 0.7738 # 9
Continual Learning DSC (10 tasks) KAN F1 - macro 0.8123 # 4

Methods


No methods listed for this paper. Add relevant methods here