Search Results for author:
Found 41 papers, 7 papers with code
FedPaI: Achieving Extreme Sparsity in Federated Learning via Pruning at Initialization
Experimental results demonstrate that FedPaI consistently outperforms existing efficient FL that applies conventional iterative pruning with significant leading in efficiency and model accuracy.
Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogenous Federated Learning
Many existing studies adopt the logit ensemble method to perform KD on the server side.
Leveraging Uncertainty Estimation for Efficient LLM Routing
Deploying large language models (LLMs) in edge-cloud environments requires an efficient routing strategy to balance cost and response quality.
Experience-replay Innovative Dynamics
Replicator dynamics, the most well-known model from evolutionary game theory (EGT), provide a theoretical framework for the convergence of the trajectories to Nash equilibria and, as a result, have been used to ensure formal guarantees for MARL algorithms in stable game settings.
Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios
Artificial Intelligence (AI) has become essential in modern healthcare, with large language models (LLMs) offering promising advances in clinical decision-making.
Legal Evalutions and Challenges of Large Language Models
In this paper, we review legal testing methods based on Large Language Models (LLMs), using the OPENAI o1 model as a case study to evaluate the performance of large models in applying legal provisions.
Analyzing Nobel Prize Literature with Large Language Models
This study examines the capabilities of advanced Large Language Models (LLMs), particularly the o1 model, in the context of literary analysis.
3D-CT-GPT: Generating 3D Radiology Reports through Integration of Large Vision-Language Models
Medical image analysis is crucial in modern radiological diagnostics, especially given the exponential growth in medical imaging data.
HARP: Human-Assisted Regrouping with Permutation Invariant Critic for Multi-Agent Reinforcement Learning
In this paper, we propose HARP (Human-Assisted Regrouping with Permutation Invariant Critic), a multi-agent reinforcement learning framework designed for group-oriented tasks.
Multi-agent Reinforcement Learning
reinforcement-learning
+1
Identifying Influential nodes in Brain Networks via Self-Supervised Graph-Transformer
This approach enables the exploration of I-nodes for brain networks, which is also lacking in current studies.
A Survey of Foundation Models for Music Understanding
Music is essential in daily life, fulfilling emotional and entertainment needs, and connecting us personally, socially, and culturally.
ModalityMirror: Improving Audio Classification in Modality Heterogeneity Federated Learning with Multimodal Distillation
Multimodal Federated Learning frequently encounters challenges of client modality heterogeneity, leading to undesired performances for secondary modality in multimodal learning.
Potential of Multimodal Large Language Models for Data Mining of Medical Images and Free-text Reports
Our experimental results demonstrated that Gemini-series models excelled in report generation and lesion detection but faces challenges in disease classification and anatomical localization.
Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training
In Federated Learning (FL), clients may have weak devices that cannot train the full model or even hold it in their memory space.
Creating a Lens of Chinese Culture: A Multimodal Dataset for Chinese Pun Rebus Art Understanding
Large vision-language models (VLMs) have demonstrated remarkable abilities in understanding everyday content.
Revisiting OPRO: The Limitations of Small-Scale LLMs as Optimizers
Numerous recent works aim to enhance the efficacy of Large Language Models (LLMs) through strategic prompting.
Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning
This data-reliance may lead to low generalization of the learned alignment relationships.
Understanding LLMs: A Comprehensive Overview from Training to Inference
Low-cost training and deployment of LLMs represent the future development trend.
High Efficiency Inference Accelerating Algorithm for NOMA-based Mobile Edge Computing
Specifically, when the mobile user has a large model inference task needed to be calculated in the NOMA-based MEC, it will take the energy consumption of both device and edge server and the inference latency into account to find the optimal model split strategy, subchannel allocation strategy (uplink and downlink), and transmission power allocation strategy (uplink and downlink).
The DURel Annotation Tool: Human and Computational Measurement of Semantic Proximity, Sense Clusters and Semantic Change
We present the DURel tool that implements the annotation of semantic proximity between uses of words into an online, open source interface.
Holistic Evaluation of GPT-4V for Biomedical Imaging
GPT-4V represents a breakthrough in artificial general intelligence (AGI) for computer vision, with applications in the biomedical domain.
ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data
Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels.
FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things
However, most existing FL works do not use datasets collected from authentic IoT devices and thus do not capture unique modalities and inherent challenges of IoT data.
Chat2Brain: A Method for Mapping Open-Ended Semantic Queries to Brain Activation Maps
In this study, we propose a method called Chat2Brain that combines LLMs to basic text-2-image model, known as Text2Brain, to map open-ended semantic queries to brain activation maps in data-scarce and complex query environments.
Evaluating Large Language Models for Radiology Natural Language Processing
The rise of large language models (LLMs) has marked a pivotal shift in the field of natural language processing (NLP).
Review of Large Vision Models and Visual Prompt Engineering
This review aims to summarize the methods employed in the computer vision domain for large vision models and visual prompt engineering, exploring the latest advancements in visual prompt engineering.
FedMultimodal: A Benchmark For Multimodal Federated Learning
In order to facilitate the research in multimodal FL, we introduce FedMultimodal, the first FL benchmark for multimodal learning covering five representative multimodal applications from ten commonly used datasets with a total of eight unique modalities.
GPT-FL: Generative Pre-trained Model-Assisted Federated Learning
Through comprehensive ablation analysis across various data modalities, we discover that the downstream model generated by synthetic data plays a crucial role in controlling the direction of gradient diversity during FL training, which enhances convergence speed and contributes to the notable accuracy boost observed with GPT-FL.
ChatABL: Abductive Learning via Natural Language Interaction with ChatGPT
The proposed method uses the strengths of LLMs' understanding and logical reasoning to correct the incomplete logical facts for optimizing the performance of perceptual module, by summarizing and reorganizing reasoning rules represented in natural language format.
An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT
The 'Impression' section of a radiology report is a critical basis for communication between radiologists and other physicians, and it is typically written by radiologists based on the 'Findings' section.
TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Training
However, we show empirically that this method can lead to a substantial drop in training accuracy as well as a slower convergence rate.
When Brain-inspired AI Meets AGI
Artificial General Intelligence (AGI) has been a long-standing goal of humanity, with the aim of creating machines capable of performing any intellectual task that humans can do.
Rectify ViT Shortcut Learning by Visual Saliency
In this work, we propose a novel and effective saliency-guided vision transformer (SGT) model to rectify shortcut learning in ViT with the absence of eye-gaze data.
Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning
To address this problem, we propose to infuse human experts' intelligence and domain knowledge into the training of deep neural networks.
Brain Cortical Functional Gradients Predict Cortical Folding Patterns via Attention Mesh Convolution
The convolution on mesh considers the spatial organization of functional gradients and folding patterns on a cortical sheet and the newly designed channel attention block enhances the interpretability of the contribution of different functional gradients to cortical folding prediction.
A Unified and Biologically-Plausible Relational Graph Representation of Vision Transformers
The key characteristic of these ViT models is to adopt different aggregation strategies of spatial patch information within the artificial neural networks (ANNs).
Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning
However, for data-intensive models such as vision transformer (ViT), current fine-tuning based FSL approaches are inefficient in knowledge generalization and thus degenerate the downstream task performances.
Federated Learning for Internet of Things: Applications, Challenges, and Opportunities
In this paper, we will discuss the opportunities and challenges of FL in IoT platforms, as well as how it can enable diverse IoT applications.
Layer-wise Adaptive Model Aggregation for Scalable Federated Learning
In Federated Learning, a common approach for aggregating local models across clients is periodic averaging of the full model parameters.
Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection
In this paper, to further push forward this direction with a comprehensive study in both algorithm and system design, we build FedIoT platform that contains FedDetect algorithm for on-device anomaly data detection and a system design for realistic evaluation of federated learning on IoT devices.
Individualized ROI Optimization via Maximization of Group-wise Consistency of Structural and Functional Profiles
Our strategy is to formulate the individual ROI optimization as a group variance minimization problem, in which group-wise functional and structural connectivity patterns, and anatomic profiles are defined as optimization constraints.
