Deep Tabular Learning

Hierarchical Multi-Task Learning

Introduced by S{\o}gaard et al. in Deep multi-task learning with low level tasks supervised at lower layers

Multi-task learning (MTL) introduces an inductive bias, based on a-priori relations between tasks: the trainable model is compelled to model more general dependencies by using the abovementioned relation as an important data feature. Hierarchical MTL, in which different tasks use different levels of the deep neural network, provides more effective inductive bias compared to “flat” MTL. Also, hierarchical MTL helps to solve the vanishing gradient problem in deep learning.

Source: Deep multi-task learning with low level tasks supervised at lower layers

Papers


Paper Code Results Date Stars

Components


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories