Search Results for author:
Found 49 papers, 8 papers with code
Eye-gaze Guided Multi-modal Alignment Framework for Radiology
Additionally, we explore the impact of varying amounts of eye-gaze data on model performance, highlighting the feasibility and utility of integrating this auxiliary data into multi-modal pre-training.
InterLUDE: Interactions between Labeled and Unlabeled Data to Enhance Semi-Supervised Learning
In this paper, we introduce InterLUDE, a new approach to enhance SSL made of two parts that each benefit from labeled-unlabeled interaction.
Holistic Evaluation of GPT-4V for Biomedical Imaging
GPT-4V represents a breakthrough in artificial general intelligence (AGI) for computer vision, with applications in the biomedical domain.
ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data
Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels.
PolicyGPT: Automated Analysis of Privacy Policies with Large Language Models
In this study, we investigate a privacy policy text analysis framework PolicyGPT based on the LLM.
NoisyNN: Exploring the Influence of Information Entropy Change in Learning Systems
Herein, we use the information entropy to define the complexity of the task.
Ranked #267 on
Image Classification
on ImageNet
RadOnc-GPT: A Large Language Model for Radiation Oncology
This paper presents RadOnc-GPT, a large language model specialized for radiation oncology through advanced tuning methods.
Radiology-Llama2: Best-in-Class Large Language Model for Radiology
This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning.
Robust Core-Periphery Constrained Transformer for Domain Adaptation
Unsupervised domain adaptation (UDA) aims to learn transferable representation across domains.
Evaluating Large Language Models for Radiology Natural Language Processing
The rise of large language models (LLMs) has marked a pivotal shift in the field of natural language processing (NLP).
Hierarchical Semantic Tree Concept Whitening for Interpretable Image Classification
With the popularity of deep neural networks (DNNs), model interpretability is becoming a critical concern.
Exploring Multimodal Approaches for Alzheimer's Disease Detection Using Patient Speech Transcript and Audio Data
As AD impairs the patient's language understanding and expression ability, the speech of AD patients can serve as an indicator of this disease.
Identification of Causal Relationship between Amyloid-beta Accumulation and Alzheimer's Disease Progression via Counterfactual Inference
Alzheimer's disease (AD) is a neurodegenerative disorder that is beginning with amyloidosis, followed by neuronal loss and deterioration in structure, function, and cognition.
Review of Large Vision Models and Visual Prompt Engineering
This review aims to summarize the methods employed in the computer vision domain for large vision models and visual prompt engineering, exploring the latest advancements in visual prompt engineering.
SAMAug: Point Prompt Augmentation for Segment Anything Model
Starting with an initial point prompt, SAM produces an initial mask, which is then fed into our proposed SAMAug to generate augmented point prompts.
Segment Anything Model (SAM) for Radiation Oncology
Given that SAM, a model pre-trained purely on natural images, can handle the delineation of OARs from medical images with clinically acceptable accuracy, these results highlight SAM's robust generalization capabilities with consistent accuracy in automatic segmentation for radiotherapy.
AD-AutoGPT: An Autonomous GPT for Alzheimer's Disease Infodemiology
In this pioneering study, inspired by AutoGPT, the state-of-the-art open-source application based on the GPT-4 large language model, we develop a novel tool called AD-AutoGPT which can conduct data collection, processing, and analysis about complex health narratives of Alzheimer's Disease in an autonomous manner via users' textual prompts.
Radiology-GPT: A Large Language Model for Radiology
We introduce Radiology-GPT, a large language model for radiology.
Artificial General Intelligence for Medical Imaging
In this review, we explore the potential applications of Artificial General Intelligence (AGI) models in healthcare, focusing on foundational Large Language Models (LLMs), Large Vision Models, and Large Multimodal Models.
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT
Prompts have been proven to play a crucial role in large language models, and in recent years, vision models have also been using prompts to improve scalability for multiple downstream tasks.
Prompt Engineering for Healthcare: Methodologies and Applications
Prompt engineering is a critical technique in the field of natural language processing that involves designing and optimizing the prompts used to input information into models, aiming to enhance their performance on specific tasks.
Differentiate ChatGPT-generated and Human-written Medical Texts
We focus on analyzing the differences between medical texts written by human experts and generated by ChatGPT, and designing machine learning workflows to effectively detect and differentiate medical texts generated by ChatGPT.
ChatABL: Abductive Learning via Natural Language Interaction with ChatGPT
The proposed method uses the strengths of LLMs' understanding and logical reasoning to correct the incomplete logical facts for optimizing the performance of perceptual module, by summarizing and reorganizing reasoning rules represented in natural language format.
Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Task
To this end, in this study, we evaluate the performance of ChatGPT/GPT-4 on a radiology NLI task and compare it to other models fine-tuned specifically on task-related data samples.
ImpressionGPT: An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT
The 'Impression' section of a radiology report is a critical basis for communication between radiologists and other physicians, and it is typically written by radiologists based on the 'Findings' section.
AGI for Agriculture
Artificial General Intelligence (AGI) is poised to revolutionize a variety of sectors, including healthcare, finance, transportation, and education.
Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
This paper presents a comprehensive survey of ChatGPT-related (GPT-3. 5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains.
When Brain-inspired AI Meets AGI
Artificial General Intelligence (AGI) has been a long-standing goal of humanity, with the aim of creating machines capable of performing any intellectual task that humans can do.
CP-CNN: Core-Periphery Principle Guided Convolutional Neural Network
In this study, We explore a novel brain-inspired design principle based on the core-periphery property of the human brain network to guide the design of CNNs.
Core-Periphery Principle Guided Redesign of Self-Attention in Transformers
Designing more efficient, reliable, and explainable neural network architectures is critical to studies that are based on artificial intelligence (AI) techniques.
DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4
The digitization of healthcare has facilitated the sharing and re-using of medical data but has also raised concerns about confidentiality and privacy.
AugGPT: Leveraging ChatGPT for Text Data Augmentation
Text data augmentation is an effective strategy for overcoming the challenge of limited sample sizes in many natural language processing (NLP) tasks.
Mask-guided BERT for Few Shot Text Classification
The main challenge of FSL is the difficulty of training robust models on small amounts of samples, which frequently leads to overfitting.
Gyri vs. Sulci: Disentangling Brain Core-Periphery Functional Networks via Twin-Transformer
To solve this fundamental problem, we design a novel Twin-Transformer framework to unveil the unique functional roles of gyri and sulci as well as their relationship in the whole brain function.
BI AVAN: Brain inspired Adversarial Visual Attention Network
Visual attention is a fundamental mechanism in the human brain, and it inspires the design of attention mechanisms in deep neural networks.
Coupling Visual Semantics of Artificial Neural Networks and Human Brain Function via Synchronized Activations
However, whether there exists semantic correlations/connections between the visual representations in ANNs and those in BNNs remains largely unexplored due to both the lack of an effective tool to link and couple two different domains, and the lack of a general and effective framework of representing the visual semantics in BNNs such as human functional brain networks (FBNs).
Rectify ViT Shortcut Learning by Visual Saliency
In this work, we propose a novel and effective saliency-guided vision transformer (SGT) model to rectify shortcut learning in ViT with the absence of eye-gaze data.
Representing Brain Anatomical Regularity and Variability by Few-Shot Embedding
Our experimental results show that: 1) the learned embedding vectors can quantitatively encode the commonality and individuality of cortical folding patterns; 2) with the embeddings we can robustly infer the complicated many-to-many anatomical correspondences among different brains and 3) our model can be successfully transferred to new populations with very limited training samples.
Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning
To address this problem, we propose to infuse human experts' intelligence and domain knowledge into the training of deep neural networks.
Brain Cortical Functional Gradients Predict Cortical Folding Patterns via Attention Mesh Convolution
The convolution on mesh considers the spatial organization of functional gradients and folding patterns on a cortical sheet and the newly designed channel attention block enhances the interpretability of the contribution of different functional gradients to cortical folding prediction.
A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformers
The key characteristic of these ViT models is to adopt different aggregation strategies of spatial patch information within the artificial neural networks (ANNs).
Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning
However, for data-intensive models such as vision transformer (ViT), current fine-tuning based FSL approaches are inefficient in knowledge generalization and thus degenerate the downstream task performances.
Discovering Dynamic Functional Brain Networks via Spatial and Channel-wise Attention
More importantly, our proposed hybrid attention modules (SA and CA) do not enforce assumptions of linearity and independence as previous methods, and thus provide a novel approach to better understanding dynamic functional brain networks.
Disentangling Spatial-Temporal Functional Brain Networks via Twin-Transformers
In this work, we propose a novel Twin-Transformers framework to simultaneously infer common and individual functional networks in both spatial and temporal space, in a self-supervised manner.
Representative Functional Connectivity Learning for Multiple Clinical groups in Alzheimer's Disease
By mapping the learned clinical group related feature vectors to the original FC space, representative FCs were constructed for each group.
Disease2Vec: Representing Alzheimer's Progression via Disease Embedding Tree
By disease em-bedding, the framework generates a disease embedding tree (DETree) which effectively represents different clinical stages as a tree trajectory reflecting AD progression and thus can be used to predict clinical status by projecting individuals onto this continuous trajectory.
Classification of Major Depressive Disorder via Multi-Site Weighted LASSO Model
Within each iteration, the classification result and the selected features are collected to update the weighting parameters for each feature.
Large-scale Feature Selection of Risk Genetic Factors for Alzheimer's Disease via Distributed Group Lasso Regression
Then we select the relevant group features by performing the group Lasso feature selection process in a sequence of parameters.
Individualized ROI Optimization via Maximization of Group-wise Consistency of Structural and Functional Profiles
Our strategy is to formulate the individual ROI optimization as a group variance minimization problem, in which group-wise functional and structural connectivity patterns, and anatomic profiles are defined as optimization constraints.
