Lifelong Learning

Lifelong Infinite Mixture

Introduced by Ye et al. in Lifelong Infinite Mixture Model Based on Knowledge-Driven Dirichlet Process

LIMix, or Lifelong Infinite Mixture, is a lifelong learning model which grows a mixture of models to adapt to an increasing number of tasks. LIMix can automatically expand its network architectures or choose an appropriate component to adapt its parameters for learning a new task, while preserving its previously learnt information. Knowledge is incorporated by means of Dirichlet processes by using a gating mechanism which computes the dependence between the knowledge learnt previously and stored in each component, and a new set of data. Besides, a Student model is trained which can accumulate cross-domain representations over time and make quick inferences.

Source: Lifelong Infinite Mixture Model Based on Knowledge-Driven Dirichlet Process

Papers


Paper Code Results Date Stars

Components


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories