Interactive and Explainable Region-guided Radiology Report Generation

The automatic generation of radiology reports has the potential to assist radiologists in the time-consuming task of report writing. Existing methods generate the full report from image-level features, failing to explicitly focus on anatomical regions in the image. We propose a simple yet effective region-guided report generation model that detects anatomical regions and then describes individual, salient regions to form the final report. While previous methods generate reports without the possibility of human intervention and with limited explainability, our method opens up novel clinical use cases through additional interactive capabilities and introduces a high degree of transparency and explainability. Comprehensive experiments demonstrate our method's effectiveness in report generation, outperforming previous state-of-the-art models, and highlight its interactive capabilities. The code and checkpoints are available at .

PDF Abstract CVPR 2023 PDF CVPR 2023 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Medical Report Generation MIMIC-CXR RGRG BLEU-1 37.3 # 1
BLEU-2 24.9 # 1
BLEU-3 17.5 # 1
BLEU-4 12.6 # 1
METEOR 16.8 # 1
ROUGE-L 26.4 # 1
CIDEr 49.5 # 1
Micro-Precision-5 0.491 # 1
Micro-Recall-5 0.617 # 1
Micro-F1-5 0.547 # 1
Example-Precision-14 0.461 # 1
Example-Recall-14 0.475 # 1
Example-F1-14 0.447 # 1


No methods listed for this paper. Add relevant methods here