Search Results for author:
Found 14 papers, 7 papers with code
Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation
To address this gap, we established a most comprehensive benchmark to evaluate the performance of off-the-shelf foundation models across six distinct clinical task types, encompassing a total of 39 specific tasks.
A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model
To our knowledge, this is the first attempt to incorporate multimodal knowledge at the slide level for enhancing pathology FMs, expanding the modelling context from unimodal to multimodal knowledge and from patch-level to slide-level.
Multimodal Data Integration for Precision Oncology: Challenges and Future Directions
The essence of precision oncology lies in its commitment to tailor targeted treatments and care measures to each patient based on the individual characteristics of the tumor.
GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist Collaboration
Specifically, we propose a cooperative framework, Generalist-Specialist Collaboration (GSCo), which consists of two stages, namely the construction of GFM and specialists, and collaborative inference on downstream tasks.
iMD4GC: Incomplete Multimodal Data Integration to Advance Precise Treatment Response Prediction and Survival Analysis for Gastric Cancer
The limited availability of modalities for each patient would cause information loss, adversely affecting predictive accuracy.
Histo-Genomic Knowledge Distillation For Cancer Prognosis From Histopathology Whole Slide Images
G-HANet is expected to be explored as a useful tool by the research community to address the current bottleneck of insufficient histo-genomic data pairing in the context of cancer prognosis and precision oncology.
HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction
Histopathology serves as the gold standard in cancer diagnosis, with clinical reports being vital in interpreting and understanding this process, guiding cancer treatment and patient care.
Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Prediction
Despite advantages of multimodal learning for cancer survival prediction, massive redundancy in multimodal data prevents it from extracting discriminative and compact information: (1) An extensive amount of intra-modal task-unrelated information blurs discriminability, especially for gigapixel whole slide images (WSIs) with many patches in pathology and thousands of pathways in genomic data, leading to an ``intra-modal redundancy" issue.
Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Prediction
Survival prediction is a complicated ordinal regression task that aims to predict the ranking risk of death, which generally benefits from the integration of histology and genomic data.
Modeling Hierarchical Structural Distance for Unsupervised Domain Adaptation
Compared with the ground distance of the conventional domain-level OT, the image-level OT captures structural associations among local regions of images that are beneficial to classification.
Graph-based Visual-Semantic Entanglement Network for Zero-shot Image Recognition
Zero-shot learning uses semantic attributes to connect the search space of unseen objects.
Multiple Attentional Pyramid Networks for Chinese Herbal Recognition
Finally, a new framework for Chinese herbal recognition is proposed as a new application of APN.
Stochastic Region Pooling: Make Attention More Expressive
Global Average Pooling (GAP) is used by default on the channel-wise attention mechanism to extract channel descriptors.
Chinese Herbal Recognition based on Competitive Attentional Fusion of Multi-hierarchies Pyramid Features
According to the characteristics of herbal images, we proposed the competitive attentional fusion pyramid networks to model the features of herbal image, which mdoels the relationship of feature maps from different levels, and re-weights multi-level channels with channel-wise attention mechanism.
