Coherent and Concise Radiology Report Generation via Context Specific Image Representations and Orthogonal Sentence States
Neural models for text generation are often designed in an end-to-end fashion, typically with zero control over intermediate computations, limiting their practical usability in downstream applications. In this work, we incorporate explicit means into neural models to ensure topical continuity, informativeness and content diversity of generated radiology reports. For the purpose we propose a method to compute image representations specific to each sentential context and eliminate redundant content by exploiting diverse sentence states. We conduct experiments to generate radiology reports from medical images of chest x-rays using MIMIC-CXR. Our model outperforms baselines by up to 18{\%} and 29{\%} respective in the evaluation for informativeness and content ordering respectively, relative on objective metrics and 16{\%} on human evaluation.
PDF Abstract
