Improving Representation of High-frequency Components for Medical Foundation Models

1 code implementation • 19 Jul 2024 • Yuetan Chu, Yilan Zhang, Zhongyi Han, Changchun Yang, Longxi Zhou, Gongning Luo, Xin Gao

Foundation models have recently attracted significant attention for their impressive generalizability across diverse downstream tasks.

Lung Nodule Detection

Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Prediction

1 code implementation • 3 Jan 2024 • Yilan Zhang, Yingxue Xu, Jianqi Chen, Fengying Xie, Hao Chen

Despite advantages of multimodal learning for cancer survival prediction, massive redundancy in multimodal data prevents it from extracting discriminative and compact information: (1) An extensive amount of intra-modal task-unrelated information blurs discriminability, especially for gigapixel whole slide images (WSIs) with many patches in pathology and thousands of pathways in genomic data, leading to an ``intra-modal redundancy" issue.

Disentanglement Survival Prediction +1

Zero-Shot Image Harmonization with Generative Model Prior

1 code implementation • 17 Jul 2023 • Jianqi Chen, Yilan Zhang, Zhengxia Zou, Keyan Chen, Zhenwei Shi

Initially, we employ a pretrained vision-language model (VLM) to generate descriptions for the composite image.

Image Harmonization Language Modelling

ECL: Class-Enhancement Contrastive Learning for Long-tailed Skin Lesion Classification

1 code implementation • 9 Jul 2023 • Yilan Zhang, Jianqi Chen, Ke Wang, Fengying Xie

In this paper, we propose class-Enhancement Contrastive Learning (ECL), which enriches the information of minority classes and treats different classes equally.

Contrastive Learning Lesion Classification +1

Diffusion Models for Imperceptible and Transferable Adversarial Attack

1 code implementation • 14 May 2023 • Jianqi Chen, Hao Chen, Keyan Chen, Yilan Zhang, Zhengxia Zou, Zhenwei Shi

Many existing adversarial attacks generate $L_p$-norm perturbations on image RGB space.

Adversarial Attack

Dense Pixel-to-Pixel Harmonization via Continuous Image Representation

1 code implementation • 3 Mar 2023 • Jianqi Chen, Yilan Zhang, Zhengxia Zou, Keyan Chen, Zhenwei Shi

High-resolution (HR) image harmonization is of great significance in real-world applications such as image synthesis and image editing.

Image Harmonization

TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis

1 code implementation • 21 Nov 2022 • Yilan Zhang, Fengying Xie, Jianqi Chen

Multi-modal skin lesion diagnosis (MSLD) has achieved remarkable success by modern computer-aided diagnosis (CAD) technology based on deep convolutions.

A Rotation Meanout Network with Invariance for Dermoscopy Image Classification and Retrieval

1 code implementation • 1 Aug 2022 • Yilan Zhang, Fengying Xie, Xuedong Song, Hangning Zhou, Yiguang Yang, Haopeng Zhang, Jie Liu

As such they have made great improvements in many tasks of dermoscopy images.

Image Classification Retrieval