Taming the Herd: Multi-Modal Meta-Learning with a Population of Agents

Meta-learning is a paradigm whereby an agent is trained with the specific goal of fast adaptation. With promising recent results, it is an effective way to use prior knowledge for future learning. However, most of the prominent successes focus entirely on adapting to similar tasks, from a unimodal distribution. This drastically differs from the real world, where problems may be more diverse. In this paper we address this issue, and provide a simple approach to solve it, which we call Taming the Herd. The Herd refers to a population of agents, each specializing on a subset (or mode) of the task distribution. At test time, we automatically allocate the appropriate member of the Herd and thus perform comparably with an oracle trained solely on those tasks. We apply our approach to both MAML and PEARL, and demonstrate its efficacy on a simple yet challenging multi-modal task distribution.

PDF Abstract
No code implementations yet. Submit your code now

Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods


No methods listed for this paper. Add relevant methods here