BreastScreening: On the Use of Multi-Modality in Medical Imaging Diagnosis

7 Apr 2020  ·  Francisco Maria Calisto, Nuno Jardim Nunes, Jacinto Carlos Nascimento ·

This paper describes the field research, design and comparative deployment of a multimodal medical imaging user interface for breast screening. The main contributions described here are threefold: 1) The design of an advanced visual interface for multimodal diagnosis of breast cancer (BreastScreening); 2) Insights from the field comparison of single vs multimodality screening of breast cancer diagnosis with 31 clinicians and 566 images, and 3) The visualization of the two main types of breast lesions in the following image modalities: (i) MammoGraphy (MG) in both Craniocaudal (CC) and Mediolateral oblique (MLO) views; (ii) UltraSound (US); and (iii) Magnetic Resonance Imaging (MRI). We summarize our work with recommendations from the radiologists for guiding the future design of medical imaging interfaces.

PDF Abstract


Results from the Paper

 Ranked #1 on Medical Diagnosis on BreastDICOM4 (using extra training data)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Medical Diagnosis BreastDICOM4 DenseNet-161 Average Precision 0.74 # 1
Average Recall 0.68 # 1