Search Results for author: Siyuan Yan

Found 12 papers, 6 papers with code

OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretraining

no code implementations23 Nov 2024 Ming Hu, Kun Yuan, Yaling Shen, Feilong Tang, Xiaohao Xu, Lin Zhou, Wei Li, Ying Chen, Zhongxing Xu, Zelin Peng, Siyuan Yan, Vinkle Srivastav, Diping Song, Tianbin Li, Danli Shi, Jin Ye, Nicolas Padoy, Nassir Navab, Junjun He, ZongYuan Ge

Surgical practice involves complex visual interpretation, procedural skills, and advanced medical knowledge, making surgical vision-language pretraining (VLP) particularly challenging due to this complexity and the limited availability of annotated data.

Representation Learning Retrieval

A General-Purpose Multimodal Foundation Model for Dermatology

1 code implementation19 Oct 2024 Siyuan Yan, Zhen Yu, Clare Primiero, Cristina Vico-Alonso, Zhonghua Wang, Litao Yang, Philipp Tschandl, Ming Hu, Gin Tan, Vincent Tang, Aik Beng Ng, David Powell, Paul Bonnington, Simon See, Monika Janda, Victoria Mar, Harald Kittler, H. Peter Soyer, ZongYuan Ge

Here, we introduce PanDerm, a multimodal dermatology foundation model pretrained through self-supervised learning on a dataset of over 2 million real-world images of skin diseases, sourced from 11 clinical institutions across 4 imaging modalities.

Lesion Segmentation Self-Supervised Learning +1

MONICA: Benchmarking on Long-tailed Medical Image Classification

1 code implementation2 Oct 2024 Lie Ju, Siyuan Yan, Yukun Zhou, Yang Nan, Xiaodan Xing, Peibo Duan, ZongYuan Ge

We hope this codebase serves as a comprehensive and reproducible benchmark, encouraging further advancements in long-tailed medical image learning.

Benchmarking Image Classification +2

Diffusion Model Driven Test-Time Image Adaptation for Robust Skin Lesion Classification

no code implementations18 May 2024 Ming Hu, Siyuan Yan, Peng Xia, Feilong Tang, Wenxue Li, Peibo Duan, Lin Zhang, ZongYuan Ge

In this paper, we propose a test-time image adaptation method to enhance the accuracy of the model on test data by simultaneously updating and predicting test images.

Lesion Classification Skin Lesion Classification

Enhancing Vision-Language Models Generalization via Diversity-Driven Novel Feature Synthesis

no code implementations4 May 2024 Siyuan Yan, Cheng Luo, Zhen Yu, ZongYuan Ge

To address this, we propose a plug-and-play feature synthesis method called LDFS (Language-Guided Diverse Feature Synthesis) to synthesize new domain features and improve existing CLIP fine-tuning strategies.

Diversity Zero-shot Generalization

Prompt-driven Latent Domain Generalization for Medical Image Classification

2 code implementations5 Jan 2024 Siyuan Yan, Chi Liu, Zhen Yu, Lie Ju, Dwarikanath Mahapatra, Brigid Betz-Stablein, Victoria Mar, Monika Janda, Peter Soyer, ZongYuan Ge

To address these challenges, we propose a novel DG framework for medical image classification without relying on domain labels, called Prompt-driven Latent Domain Generalization (PLDG).

Domain Generalization Image Classification +2

EPVT: Environment-aware Prompt Vision Transformer for Domain Generalization in Skin Lesion Recognition

1 code implementation4 Apr 2023 Siyuan Yan, Chi Liu, Zhen Yu, Lie Ju, Dwarikanath Mahapatrainst, Victoria Mar, Monika Janda, Peter Soyer, ZongYuan Ge

Concretely, EPVT leverages a set of domain prompts, each of which plays as a domain expert, to capture domain-specific knowledge; and a shared prompt for general knowledge over the entire dataset.

Domain Generalization General Knowledge

Transmission-Guided Bayesian Generative Model for Smoke Segmentation

1 code implementation2 Mar 2023 Siyuan Yan, Jing Zhang, Nick Barnes

To effectively model the two types of uncertainty, we introduce a Bayesian generative model to simultaneously estimate the posterior distribution of model parameters and its predictions.

Image Dehazing Image Segmentation +2

Towards Trustable Skin Cancer Diagnosis via Rewriting Model's Decision

no code implementations CVPR 2023 Siyuan Yan, Zhen Yu, Xuelin Zhang, Dwarikanath Mahapatra, Shekhar S. Chandra, Monika Janda, Peter Soyer, ZongYuan Ge

We introduce a human-in-the-loop framework in the model training process such that users can observe and correct the model's decision logic when confounding behaviors happen.

Decision Making

An overlapping-free leaf segmentation method for plant point clouds

no code implementations12 Aug 2019 Dawei Li, Yan Cao, Guoliang Shi, Xin Cai, Yang Chen, Sifan Wang, Siyuan Yan

The proposed method can also facilitate the automatic traits estimation of each single leaf (such as the leaf area, length, and width), which has potential to become a highly effective tool for plant research and agricultural engineering.

Plant Phenotyping Segmentation

An Integrated Image Filter for Enhancing Change Detection Results

no code implementations2 Jul 2019 Dawei Li, Siyuan Yan, Xin Cai, Yan Cao, Sifan Wang

In this paper, we present an integrated filter which comprises a weighted local guided image filter and a weighted spatiotemporal tree filter.

Change Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.