Medical Multimodal Classifiers Under Scarce Data Condition

no code implementations • 24 Feb 2019 • Faik Aydin, Maggie Zhang, Michelle Ananda-Rajah, Gholamreza Haffari

To overcome the challenges of the small training dataset which only has 3K frontal X-ray images and medical reports in pairs, we have adopted transfer learning for the multimodal which concatenates the layers of image and text submodels.

Clustering Transfer Learning