Search Results for author:
Found 50 papers, 32 papers with code
A Survey of Medical Vision-and-Language Applications and Their Techniques
Unlike general vision-and-language models trained on diverse, non-specialized datasets, MVLMs are purpose-built for the medical domain, automatically extracting and interpreting critical information from medical images and textual reports to support clinical decision-making.
Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?
We are committed to expanding this benchmark to encourage more innovation of AI algorithms for the medical domain.
MedUniSeg: 2D and 3D Medical Image Segmentation via a Prompt-driven Universal Model
In this paper, we introduce MedUniSeg, a prompt-driven universal segmentation model designed for 2D and 3D multi-task segmentation across diverse modalities and domains.
A Novel Perspective for Multi-modal Multi-label Skin Lesion Classification
The efficacy of deep learning-based Computer-Aided Diagnosis (CAD) methods for skin diseases relies on analyzing multiple data modalities (i. e., clinical+dermoscopic images, and patient metadata) and addressing the challenges of multi-label classification.
AdaCBM: An Adaptive Concept Bottleneck Model for Explainable and Accurate Diagnosis
This paper takes an unconventional approach by re-examining the CBM framework through the lens of its geometrical representation as a simple linear classification system.
XLIP: Cross-modal Attention Masked Modelling for Medical Language-Image Pre-Training
To this end, this paper proposes a XLIP (Masked modelling for medical Language-Image Pre-training) framework to enhance pathological learning and feature learning via unpaired data.
Structural Attention: Rethinking Transformer for Unpaired Medical Image Synthesis
To address this, we introduce UNet Structured Transformer (UNest), a novel architecture incorporating structural inductive biases for unpaired medical image synthesis.
Towards Bidirectional Human-AI Alignment: A Systematic Review for Clarifications, Framework, and Future Directions
From this, we present a conceptual framework of "Bidirectional Human-AI Alignment" to organize the literature from a human-centered perspective.
MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflows
Scientific innovation relies on detailed workflows, which include critical steps such as analyzing literature, generating ideas, validating these ideas, interpreting results, and inspiring follow-up research.
Meta-Learned Modality-Weighted Knowledge Distillation for Robust Multi-Modal Learning with Missing Data
In multi-modal learning, some modalities are more influential than others, and their absence can have a significant impact on classification/segmentation accuracy.
PairAug: What Can Augmented Image-Text Pairs Do for Radiology?
Acknowledging this limitation, our objective is to devise a framework capable of concurrently augmenting medical image and text data.
CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretation
Deep Neural Networks (DNNs) are widely used for visual classification tasks, but their complex computation process and black-box nature hinder decision transparency and interpretability.
Decomposing Disease Descriptions for Enhanced Pathology Detection: A Multi-Aspect Vision-Language Pre-training Framework
Medical vision language pre-training (VLP) has emerged as a frontier of research, enabling zero-shot pathological recognition by comparing the query image with the textual descriptions for each disease.
Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning
In this paper, we reconsider versatile self-supervised learning from the perspective of continual learning and propose MedCoSS, a continuous self-supervised learning approach for multi-modal medical data.
Segment Together: A Versatile Paradigm for Semi-Supervised Medical Image Segmentation
Therefore, in this paper, we introduce a \textbf{Ver}satile \textbf{Semi}-supervised framework (VerSemi) to point out a new perspective that integrates various tasks into a unified model with a broad label space, to exploit more unlabeled data for semi-supervised medical image segmentation.
A Turing Test: Are AI Chatbots Behaviorally Similar to Humans?
Their behaviors are often distinct from average and modal human behaviors, in which case they tend to behave on the more altruistic and cooperative end of the distribution.
3D TransUNet: Advancing Medical Image Segmentation through Vision Transformers
In this paper, we extend the 2D TransUNet architecture to a 3D network by building upon the state-of-the-art nnU-Net architecture, and fully exploring Transformers' potential in both the encoder and decoder design.
Discrepancy Matters: Learning from Inconsistent Decoder Features for Consistent Semi-supervised Medical Image Segmentation
Semi-supervised learning (SSL) has been proven beneficial for mitigating the issue of limited labeled data especially on the task of volumetric medical image segmentation.
BHSD: A 3D Multi-Class Brain Hemorrhage Segmentation Dataset
Intracranial hemorrhage (ICH) is a pathological condition characterized by bleeding inside the skull or brain, which can be attributed to various factors.
Transformer-based Annotation Bias-aware Medical Image Segmentation
This paper proposes a Transformer-based Annotation Bias-aware (TAB) medical image segmentation model, which tackles the annotator-related bias via modeling annotator preference and stochastic errors.
Attention Mechanisms in Medical Image Segmentation: A Survey
This paper systematically reviews the basic principles of attention mechanisms and their applications in medical image segmentation.
Act Like a Radiologist: Radiology Report Generation across Anatomical Regions
To address these issues, we propose X-RGen, a radiologist-minded report generation framework across six anatomical regions.
Ranked #1 on
Medical Report Generation
on IU X-Ray
(using extra training data)
UniSeg: A Prompt-driven Universal Segmentation Model as well as A Strong Representation Learner
Moreover, UniSeg also beats other pre-trained models on two downstream datasets, providing the community with a high-quality pre-trained model for 3D medical image segmentation.
A Prompt Log Analysis of Text-to-Image Generation Systems
Despite the plenty of efforts to improve the generative models, there is limited work on understanding the information needs of the users of these systems at scale.
Diffusion Model for Generative Image Denoising
In supervised learning for image denoising, usually the paired clean images and noisy images are collected or synthesised to train a denoising model.
PEFAT: Boosting Semi-Supervised Medical Image Classification via Pseudo-Loss Estimation and Feature Adversarial Training
In this paper, we propose a novel Pseudo-loss Estimation and Feature Adversarial Training semi-supervised framework, termed as PEFAT, to boost the performance of multi-class and multi-label medical image classification from the point of loss distribution modeling and adversarial training.
Image Classification
Semi-supervised Medical Image Classification
Instance-dependent Label Distribution Estimation for Learning with Label Noise
These methods heavily rely on the existence of anchor points or the quality of pseudo ones, and the global NTM can hardly provide accurate label transition information for each sample, since the label noise in real applications is mostly instance-dependent.
Learning from partially labeled data for multi-organ and tumor segmentation
To address this, we propose a Transformer based dynamic on-demand network (TransDoDNet) that learns to segment organs and tumors on multiple partially labeled datasets.
ClusTR: Exploring Efficient Self-attention via Clustering for Vision Transformers
Besides, we further extend the clustering-guided attention from single-scale to multi-scale, which is conducive to dense prediction tasks.
Region-Aware Metric Learning for Open World Semantic Segmentation via Meta-Channel Aggregation
Therefore, we propose a method called region-aware metric learning (RAML), which first separates the regions of the images and generates region-aware features for further metric learning.
Measurement-conditioned Denoising Diffusion Probabilistic Model for Under-sampled Medical Image Reconstruction
We propose a novel and unified method, measurement-conditioned denoising diffusion probabilistic model (MC-DDPM), for under-sampled medical image reconstruction based on DDPM.
Multi-View Graph Representation for Programming Language Processing: An Investigation into Algorithm Detection
We thoroughly evaluate our proposed MVG approach in the context of algorithm detection, an important and challenging subfield of PLP.
Trained Model in Supervised Deep Learning is a Conditional Risk Minimizer
We proved that a trained model in supervised deep learning minimizes the conditional risk for each input (Theorem 2. 1).
How Much Space Has Been Explored? Measuring the Chemical Space Covered by Databases and Machine-Generated Molecules
We further evaluate how well the existing databases and generation models cover the chemical space in terms of #Circles.
UniMiSS: Universal Medical Self-Supervised Learning via Breaking Dimensionality Barrier
In this paper, we advocate bringing a wealth of 2D images like chest X-rays as compensation for the lack of 3D data, aiming to build a universal medical self-supervised representation learning framework, called UniMiSS.
Modeling Annotator Preference and Stochastic Annotation Error for Medical Image Segmentation
Manual annotation of medical images is highly subjective, leading to inevitable and huge annotation biases.
Learning from Ambiguous Labels for Lung Nodule Malignancy Prediction
According to the consistency and reliability of their annotations, we divide nodules into three sets: a consistent and reliable set (CR-Set), an inconsistent set (IC-Set), and a low reliable set (LR-Set).
MARS: Markov Molecular Sampling for Multi-objective Drug Discovery
Searching for novel molecules with desired chemical properties is crucial in drug discovery.
CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation
Convolutional neural networks (CNNs) have been the de facto standard for nowadays 3D medical image segmentation.
A General Computational Framework to Measure the Expressiveness of Complex Networks using a Tight Upper Bound of Linear Regions
Inspired by the proof of this upper bound and the framework of matrix computation in \citet{hinz2019framework}, we propose a general computational approach to compute a tight upper bound of regions number for theoretically any network structures (e. g. DNN with all kind of skip connections and residual structures).
A General Computational Framework to Measure the Expressiveness of Complex Networks Using a Tighter Upper Bound of Linear Regions
Inspired by the proof of this upper bound and theframework of matrix computation in Hinz & Van de Geer (2019), we propose ageneral computational approach to compute a tight upper bound of regions numberfor theoretically any network structures (e. g. DNN with all kind of skip connec-tions and residual structures).
Inter-slice Context Residual Learning for 3D Medical Image Segmentation
In this paper, we propose the 3D context residual network (ConResNet) for the accurate segmentation of 3D medical images.
PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentation
In this paper, we propose a PriorGuided Local (PGL) self-supervised model that learns the region-wise local consistency in the latent feature space.
DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets
To address this, we propose a dynamic on-demand network (DoDNet) that learns to segment multiple organs and tumors on partially labeled datasets.
Pairwise Relation Learning for Semi-supervised Gland Segmentation
In this paper, we propose the pairwise relation-based semi-supervised (PRS^2) model for gland segmentation on histology images.
Viral Pneumonia Screening on Chest X-ray Images Using Confidence-Aware Anomaly Detection
In this paper, we formulate the task of differentiating viral pneumonia from non-viral pneumonia and healthy controls into an one-class classification-based anomaly detection problem, and thus propose the confidence-aware anomaly detection (CAAD) model, which consists of a shared feature extractor, an anomaly detection module, and a confidence prediction module.
A Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification
Our results suggest that it is possible to boost the performance of skin lesion segmentation and classification simultaneously via training a unified model to perform both tasks in a mutual bootstrapping way.
Visual Rhythm Prediction with Feature-Aligning Network
In this paper, we propose a data-driven visual rhythm prediction method, which overcomes the previous works' deficiency that predictions are made primarily by human-crafted hard rules.
A Multi-Level Deep Ensemble Model for Skin Lesion Classification in Dermoscopy Images
A multi-level deep ensemble (MLDE) model that can be trained in an 'end to end' manner is proposed for skin lesion classification in dermoscopy images.
Classification of Medical Images and Illustrations in the Biomedical Literature Using Synergic Deep Learning
The Classification of medical images and illustrations in the literature aims to label a medical image according to the modality it was produced or label an illustration according to its production attributes.
