Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction

2 code implementations • 13 Apr 2023 • Guillaume Jaume, Anurag Vaidya, Richard Chen, Drew Williamson, Paul Liang, Faisal Mahmood

We propose fusing both modalities using a memory-efficient multimodal Transformer that can model interactions between pathway and histology patch tokens.

Survival Prediction whole slide images