Search Results for author: Guang Yang

Found 193 papers, 55 papers with code

Contrast-Free Myocardial Scar Segmentation in Cine MRI using Motion and Texture Fusion

no code implementations9 Jan 2025 Guang Yang, Jingkun Chen, Xicheng Sheng, Shan Yang, Xiahai Zhuang, Betty Raman, Lei LI, Vicente Grau

Late gadolinium enhancement MRI (LGE MRI) is the gold standard for the detection of myocardial scars for post myocardial infarction (MI).

Less is More: Towards Green Code Large Language Models via Unified Structural Pruning

no code implementations20 Dec 2024 Guang Yang, Yu Zhou, Xiangyu Zhang, Wei Cheng, Ke Liu, Xiang Chen, Terry Yue Zhuo, Taolue Chen

The extensive application of Large Language Models (LLMs) in generative coding tasks has raised concerns due to their high computational demands and energy consumption.

Computational Efficiency

Are the Latent Representations of Foundation Models for Pathology Invariant to Rotation?

1 code implementation16 Dec 2024 Matouš Elphick, Samra Turajlic, Guang Yang

Self-supervised foundation models for digital pathology encode small patches from H\&E whole slide images into latent representations used for downstream tasks.

Inductive Bias whole slide images

Decoding Report Generators: A Cyclic Vision-Language Adapter for Counterfactual Explanations

no code implementations8 Nov 2024 Yingying Fang, Zihao Jin, Shaojie Guo, Jinda Liu, Yijian Gao, Junzhi Ning, Zhiling Yue, Zhi Li, Simon LF Walsh, Guang Yang

Despite significant advancements in report generation methods, a critical limitation remains: the lack of interpretability in the generated text.

counterfactual Decision Making +1

Deep Generative Models Unveil Patterns in Medical Images Through Vision-Language Conditioning

1 code implementation17 Oct 2024 Xiaodan Xing, Junzhi Ning, Yang Nan, Guang Yang

Deep generative models have significantly advanced medical imaging analysis by enhancing dataset size and quality.

Data Augmentation Image Generation +1

Arbitrarily-Conditioned Multi-Functional Diffusion for Multi-Physics Emulation

no code implementations17 Oct 2024 Da Long, Zhitong Xu, Guang Yang, Akil Narayan, Shandian Zhe

ACMFD can perform a wide range of tasks within a single framework, including forward prediction, various inverse problems, and simulating data for entire systems or subsets of quantities conditioned on others.

Denoising Gaussian Processes +1

Toward Efficient Kernel-Based Solvers for Nonlinear PDEs

no code implementations15 Oct 2024 Zhitong Xu, Da Long, Yiming Xu, Guang Yang, Shandian Zhe, Houman Owhadi

In numerical experiments, we demonstrate the advantages of our method in solving several benchmark PDEs.

Preserving Cardiac Integrity: A Topology-Infused Approach to Whole Heart Segmentation

no code implementations14 Oct 2024 Chenyu Zhang, Wenxue Guan, Xiaodan Xing, Guang Yang

Whole heart segmentation (WHS) supports cardiovascular disease (CVD) diagnosis, disease monitoring, treatment planning, and prognosis.

Heart Segmentation Segmentation

Mamba Neural Operator: Who Wins? Transformers vs. State-Space Models for PDEs

no code implementations3 Oct 2024 Chun-Wun Cheng, Jiahao Huang, Yi Zhang, Guang Yang, Carola-Bibiane Schönlieb, Angelica I Aviles-Rivero

Partial differential equations (PDEs) are widely used to model complex physical systems, but solving them efficiently remains a significant challenge.

Mamba State Space Models

From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare

no code implementations15 Sep 2024 Ming Li, Pengcheng Xu, Junjie Hu, Zeyu Tang, Guang Yang

Federated learning holds great potential for enabling large-scale healthcare research and collaboration across multiple centres while ensuring data privacy and security are not compromised.

Federated Learning

Infrared and Visible Image Fusion with Hierarchical Human Perception

no code implementations14 Sep 2024 Guang Yang, Jie Li, Xin Liu, Zhusi Zhong, Xinbo Gao

Existing methods take pixel intensity, texture and high-level vision task information as the standards to determine preservation of information, lacking enhancement for human perception.

Infrared And Visible Image Fusion Language Modeling +1

Serp-Mamba: Advancing High-Resolution Retinal Vessel Segmentation with Selective State-Space Model

no code implementations6 Sep 2024 Hongqiu Wang, Yixian Chen, Wu Chen, Huihui Xu, Haoyu Zhao, Bin Sheng, Huazhu Fu, Guang Yang, Lei Zhu

Based on the above observations, we first devise a Serpentine Interwoven Adaptive (SIA) scan mechanism, which scans UWF-SLO images along curved vessel structures in a snake-like crawling manner.

Mamba Retinal Vessel Segmentation

Coupling AI and Citizen Science in Creation of Enhanced Training Dataset for Medical Image Segmentation

no code implementations4 Sep 2024 Amir Syahmi, Xiangrong Lu, Yinxuan Li, Haoxuan Yao, Hanjun Jiang, Ishita Acharya, Shiyi Wang, Yang Nan, Xiaodan Xing, Guang Yang

Recent advancements in medical imaging and artificial intelligence (AI) have greatly enhanced diagnostic capabilities, but the development of effective deep learning (DL) models is still constrained by the lack of high-quality annotated datasets.

Image Segmentation Medical Image Segmentation +1

CT-SDM: A Sampling Diffusion Model for Sparse-View CT Reconstruction across All Sampling Rates

no code implementations3 Sep 2024 Liutao Yang, Jiahao Huang, Guang Yang, Daoqiang Zhang

Because of the reduced number of projection views, traditional reconstruction methods can lead to severe artifacts.

CT Reconstruction

Learning Task-Specific Sampling Strategy for Sparse-View CT Reconstruction

no code implementations3 Sep 2024 Liutao Yang, Jiahao Huang, Yingying Fang, Angelica I Aviles-Rivero, Carola-Bibiane Schonlieb, Daoqiang Zhang, Guang Yang

Thus, a task-specific sampling strategy can be applied for each type of scans to improve the quality of SVCT imaging and further assist in performance of downstream clinical usage.

CT Reconstruction

Explicit Differentiable Slicing and Global Deformation for Cardiac Mesh Reconstruction

2 code implementations3 Sep 2024 Yihao Luo, Dario Sesia, Fanwen Wang, Yinzhe Wu, Wenhao Ding, Jiahao Huang, Fadong Shi, Anoop Shah, Amit Kaural, Jamil Mayet, Guang Yang, ChoonHwai Yap

Here, we propose a novel explicit differentiable voxelization and slicing (DVS) algorithm that allows gradient backpropagation to a mesh from its slices, facilitating refined mesh optimization directly supervised by the losses defined on 2D images.

Anatomy

McCaD: Multi-Contrast MRI Conditioned, Adaptive Adversarial Diffusion Model for High-Fidelity MRI Synthesis

no code implementations1 Sep 2024 Sanuwani Dayarathna, Kh Tohidul Islam, Bohan Zhuang, Guang Yang, Jianfei Cai, Meng Law, Zhaolin Chen

Moreover, existing methods for multi-contrast MRI synthesis often fail to accurately map feature-level information across multiple imaging contrasts.

Denoising

Toward a More Complete OMR Solution

1 code implementation31 Aug 2024 Guang Yang, Muru Zhang, Lin Qiu, Yanming Wan, Noah A. Smith

One approach to tackle OMR is through a multi-stage pipeline, where the system first detects visual music notation elements in the image (object detection) and then assembles them into a music notation (notation assembly).

Object object-detection +1

Distribution Backtracking Builds A Faster Convergence Trajectory for Diffusion Distillation

1 code implementation28 Aug 2024 Shengyuan Zhang, Ling Yang, Zejian Li, An Zhao, Chenye Meng, Changyuan Yang, Guang Yang, Zhiyuan Yang, Lingyun Sun

However, there is a score mismatch issue in the early stage of the distillation process, because existing methods mainly focus on using the endpoint of pre-trained diffusion models as teacher models, overlooking the importance of the convergence trajectory between the student generator and the teacher model.

Hokoff: Real Game Dataset from Honor of Kings and its Offline Reinforcement Learning Benchmarks

1 code implementation NeurIPS 2023 Yun Qu, Boyuan Wang, Jianzhun Shao, Yuhang Jiang, Chen Chen, Zhenbin Ye, Lin Liu, Junfeng Yang, Lin Lai, Hongyang Qin, Minwen Deng, Juchao Zhuo, Deheng Ye, Qiang Fu, Wei Yang, Guang Yang, Lanxiao Huang, Xiangyang Ji

The advancement of Offline Reinforcement Learning (RL) and Offline Multi-Agent Reinforcement Learning (MARL) critically depends on the availability of high-quality, pre-collected offline datasets that represent real-world complexities and practical applications.

Multi-agent Reinforcement Learning Multi-Task Learning +4

Beyond the Hype: A dispassionate look at vision-language models in medical scenario

no code implementations16 Aug 2024 Yang Nan, Huichi Zhou, Xiaodan Xing, Guang Yang

RadVUQA mainly validates LVLMs across five dimensions: 1) Anatomical understanding, assessing the models' ability to visually identify biological structures; 2) Multimodal comprehension, which involves the capability of interpreting linguistic and visual instructions to produce desired outcomes; 3) Quantitative and spatial reasoning, evaluating the models' spatial awareness and proficiency in combining quantitative analysis with visual and linguistic information; 4) Physiological knowledge, measuring the models' capability to comprehend functions and mechanisms of organs and systems; and 5) Robustness, which assesses the models' capabilities against unharmonised and synthetic data.

Question Answering Spatial Reasoning

SeLoRA: Self-Expanding Low-Rank Adaptation of Latent Diffusion Model for Medical Image Synthesis

no code implementations13 Aug 2024 Yuchen Mao, Hongwei Li, Wei Pang, Giorgos Papanastasiou, Guang Yang, Chengjia Wang

The persistent challenge of medical image synthesis posed by the scarcity of annotated data and the need to synthesize `missing modalities' for multi-modal analysis, underscored the imperative development of effective synthesis methods.

Image Generation

Advancing oncology with federated learning: transcending boundaries in breast, lung, and prostate cancer. A systematic review

no code implementations8 Aug 2024 Anshu Ankolekar, Sebastian Boie, Maryam Abdollahyan, Emanuela Gadaleta, Seyed Alireza Hasheminasab, Guang Yang, Charles Beauville, Nikolaos Dikaios, George Anthony Kastis, Michael Bussmann, Sara Khalid, Hagen Kruger, Philippe Lambin, Giorgos Papanastasiou

Federated Learning (FL) has emerged as a promising solution to address the limitations of centralised machine learning (ML) in oncology, particularly in overcoming privacy concerns and harnessing the power of diverse, multi-center data.

Federated Learning

A dual-task mutual learning framework for predicting post-thrombectomy cerebral hemorrhage

no code implementations1 Aug 2024 Caiwen Jiang, Tianyu Wang, Xiaodan Xing, Mianxin Liu, Guang Yang, Zhongxiang Ding, Dinggang Shen

Ischemic stroke is a severe condition caused by the blockage of brain blood vessels, and can lead to the death of brain tissue due to oxygen deprivation.

CIResDiff: A Clinically-Informed Residual Diffusion Model for Predicting Idiopathic Pulmonary Fibrosis Progression

no code implementations1 Aug 2024 Caiwen Jiang, Xiaodan Xing, Zaixin Ou, Mianxin Liu, Walsh Simon, Guang Yang, Dinggang Shen

Specifically, from the clinical prior knowledge, we tailor improvements to the traditional diffusion model and propose a Clinically-Informed Residual Diffusion model, called CIResDiff.

Differentiable Voxelization and Mesh Morphing

2 code implementations15 Jul 2024 Yihao Luo, Yikai Wang, Zhengrui Xiang, Yuliang Xiu, Guang Yang, ChoonHwai Yap

In this paper, we propose the differentiable voxelization of 3D meshes via the winding number and solid angles.

Crafting Customisable Characters with LLMs: Introducing SimsChat, a Persona-Driven Role-Playing Agent Framework

1 code implementation25 Jun 2024 Bohao Yang, Dong Liu, Chenghao Xiao, Kun Zhao, Chen Tang, Chao Li, Lin Yuan, Guang Yang, Lanxiao Huang, Chenghua Lin

Large Language Models (LLMs) demonstrate remarkable ability to comprehend instructions and generate human-like text, enabling sophisticated agent simulation beyond basic behavior replication.

Diff3Dformer: Leveraging Slice Sequence Diffusion for Enhanced 3D CT Classification with Transformer Networks

no code implementations24 Jun 2024 Zihao Jin, Yingying Fang, Jiahao Huang, Caiwen Xu, Simon Walsh, Guang Yang

The manifestation of symptoms associated with lung diseases can vary in different depths for individual patients, highlighting the significance of 3D information in CT scans for medical image classification.

3D Classification Image Classification +1

DiffExplainer: Unveiling Black Box Models Via Counterfactual Generation

no code implementations21 Jun 2024 Yingying Fang, Shuang Wu, Zihao Jin, Caiwen Xu, Shiyi Wang, Simon Walsh, Guang Yang

To address this limitation, we propose an agent model capable of generating counterfactual images that prompt different decisions when plugged into a black box model.

counterfactual Image Classification +1

Low-rank based motion correction followed by automatic frame selection in DT-CMR

no code implementations19 Jun 2024 Fanwen Wang, Pedro F. Ferreira, Camila Munoz, Ke Wen, Yaqing Luo, Jiahao Huang, Yinzhe Wu, Dudley J. Pennell, Andrew D. Scott, Sonia Nielles-Vallespin, Guang Yang

Motivation: Post-processing of in-vivo diffusion tensor CMR (DT-CMR) is challenging due to the low SNR and variation in contrast between frames which makes image registration difficult, and the need to manually reject frames corrupted by motion.

Image Registration

Deep asymmetric mixture model for unsupervised cell segmentation

no code implementations3 Jun 2024 Yang Nan, Guang Yang

To address these issues, this paper presents a novel asymmetric mixture model for unsupervised cell segmentation.

Cell Segmentation Drug Discovery +1

Decoding Decision Reasoning: A Counterfactual-Powered Model for Knowledge Discovery

no code implementations23 May 2024 Yingying Fang, Zihao Jin, Xiaodan Xing, Simon Walsh, Guang Yang

In medical imaging, particularly in early disease detection and prognosis tasks, discerning the rationale behind an AI model's predictions is crucial for evaluating the reliability of its decisions.

counterfactual Decision Making

When AI Eats Itself: On the Caveats of AI Autophagy

no code implementations15 May 2024 Xiaodan Xing, Fadong Shi, Jiahao Huang, Yinzhe Wu, Yang Nan, Sheng Zhang, Yingying Fang, Mike Roberts, Carola-Bibiane Schönlieb, Javier Del Ser, Guang Yang

Generative Artificial Intelligence (AI) technologies and large models are producing realistic outputs across various domains, such as images, text, speech, and music.

4DBInfer: A 4D Benchmarking Toolbox for Graph-Centric Predictive Modeling on Relational DBs

1 code implementation28 Apr 2024 Minjie Wang, Quan Gan, David Wipf, Zhenkun Cai, Ning li, Jianheng Tang, Yanlin Zhang, Zizhao Zhang, Zunyao Mao, Yakun Song, Yanbo Wang, Jiahang Li, Han Zhang, Guang Yang, Xiao Qin, Chuan Lei, Muhan Zhang, Weinan Zhang, Christos Faloutsos, Zheng Zhang

Although RDBs store vast amounts of rich, informative data spread across interconnected tables, the progress of predictive machine learning models as applied to such tasks arguably falls well behind advances in other domains such as computer vision or natural language processing.

Benchmarking

Co-Optimization of Environment and Policies for Decentralized Multi-Agent Navigation

no code implementations21 Mar 2024 Zhan Gao, Guang Yang, Amanda Prorok

By introducing two sub-objectives of multi-agent navigation and environment optimization, we propose an $\textit{agent-environment co-optimization}$ problem and develop a $\textit{coordinated algorithm}$ that alternates between these sub-objectives to search for an optimal synthesis of agent actions and obstacle configurations in the environment; ultimately, improving the navigation performance.

ContrastDiagnosis: Enhancing Interpretability in Lung Nodule Diagnosis Using Contrastive Learning

no code implementations8 Mar 2024 Chenglong Wang, Yinqiao Yi, Yida Wang, Chengxiu Zhang, Yun Liu, Kensaku MORI, Mei Yuan, Guang Yang

This framework is designed to introduce inherent transparency and provide extensive post-hoc explainability for deep learning model, making them more suitable for clinical medical diagnosis.

Contrastive Learning Medical Diagnosis

Make it more specific: A novel uncertainty based airway segmentation application on 3D U-Net and its variants

no code implementations12 Feb 2024 Shiyi Wang, Yang Nan, Felder Federico N, Sheng Zhang, Walsh Simon L F, Guang Yang

The most popular algorithms in medical segmentation, 3D U-Net and its variants, can directly implement the task of lung trachea segmentation, but its failure to consider the special tree-like structure of the trachea suggests that there is much room for improvement in its segmentation accuracy.

Segmentation

HAMLET: Graph Transformer Neural Operator for Partial Differential Equations

no code implementations5 Feb 2024 Andrey Bryutkin, Jiahao Huang, Zhongying Deng, Guang Yang, Carola-Bibiane Schönlieb, Angelica Aviles-Rivero

We present a novel graph transformer framework, HAMLET, designed to address the challenges in solving partial differential equations (PDEs) using neural networks.

Assessing the Efficacy of Invisible Watermarks in AI-Generated Medical Images

no code implementations5 Feb 2024 Xiaodan Xing, Huiyu Zhou, Yingying Fang, Guang Yang

AI-generated medical images are gaining growing popularity due to their potential to address the data scarcity challenge in the real world.

Data and Physics driven Deep Learning Models for Fast MRI Reconstruction: Fundamentals and Methodologies

no code implementations29 Jan 2024 Jiahao Huang, Yinzhe Wu, Fanwen Wang, Yingying Fang, Yang Nan, Cagan Alkan, Daniel Abraham, Congyu Liao, Lei Xu, Zhifan Gao, Weiwen Wu, Lei Zhu, Zhaolin Chen, Peter Lally, Neal Bangerter, Kawin Setsompop, Yike Guo, Daniel Rueckert, Ge Wang, Guang Yang

Magnetic Resonance Imaging (MRI) is a pivotal clinical diagnostic tool, yet its extended scanning times often compromise patient comfort and image quality, especially in volumetric, temporal and quantitative scans.

Federated Learning MRI Reconstruction

A Dual Domain Multi-exposure Image Fusion Network based on the Spatial-Frequency Integration

1 code implementation17 Dec 2023 Guang Yang, Jie Li, Xinbo Gao

Specifically, we introduce a Spatial-Frequency Fusion Block to facilitate efficient interaction between dual domains and capture complementary information from input images with different exposures.

Multi-Exposure Image Fusion

A Multi-scale Information Integration Framework for Infrared and Visible Image Fusion

1 code implementation7 Dec 2023 Guang Yang, Jie Li, Hanxiao Lei, Xinbo Gao

In this study, we propose a multi-scale dual attention (MDA) framework for infrared and visible image fusion, which is designed to measure and integrate complementary information in both structure and loss function at the image and patch level.

Infrared And Visible Image Fusion

Where to Begin? From Random to Foundation Model Instructed Initialization in Federated Learning for Medical Image Segmentation

no code implementations27 Nov 2023 Ming Li, Guang Yang

In medical image analysis, Federated Learning (FL) stands out as a key technology that enables privacy-preserved, decentralized data processing, crucial for handling sensitive medical data.

Federated Learning Image Segmentation +3

Machine-Learned Atomic Cluster Expansion Potentials for Fast and Quantum-Accurate Thermal Simulations of Wurtzite AlN

no code implementations20 Nov 2023 Guang Yang, Yuan-Bin Liu, Lei Yang, Bing-Yang Cao

Using the atomic cluster expansion (ACE) framework, we develop a machine learning interatomic potential for fast and accurately modelling the phonon transport properties of wurtzite aluminum nitride.

Stain Consistency Learning: Handling Stain Variation for Automatic Digital Pathology Segmentation

1 code implementation11 Nov 2023 Michael Yeung, Todd Watts, Sean YW Tan, Pedro F. Ferreira, Andrew D. Scott, Sonia Nielles-Vallespin, Guang Yang

Numerous methods have been developed to improve the robustness of machine learning methods to stain variation, but comparative studies have demonstrated limited benefits to performance.

Reducing Spatial Fitting Error in Distillation of Denoising Diffusion Models

1 code implementation7 Nov 2023 Shengzhe Zhou, Zejian Lee, Shengyuan Zhang, Lefan Hou, Changyuan Yang, Guang Yang, Zhiyuan Yang, Lingyun Sun

Based on our analysis with bias-variance decomposition and experimental observations, we attribute the degradation to the spatial fitting error occurring in the training of both the teacher and student model.

Attribute Denoising +2

Dynamic Multimodal Information Bottleneck for Multimodality Classification

1 code implementation2 Nov 2023 Yingying Fang, Shuang Wu, Sheng Zhang, Chaoyan Huang, Tieyong Zeng, Xiaodan Xing, Simon Walsh, Guang Yang

Specifically, our information bottleneck module serves to filter out the task-irrelevant information and noises in the fused feature, and we further introduce a sufficiency loss to prevent dropping of task-relevant information, thus explicitly preserving the sufficiency of prediction information in the distilled feature.

Classification Medical Diagnosis +1

The Missing U for Efficient Diffusion Models

no code implementations31 Oct 2023 Sergio Calvo-Ordonez, Chun-Wun Cheng, Jiahao Huang, Lipei Zhang, Guang Yang, Carola-Bibiane Schonlieb, Angelica I Aviles-Rivero

Diffusion Probabilistic Models stand as a critical tool in generative modelling, enabling the generation of complex data distributions.

Denoising Image Generation +1

Data-Free Distillation Improves Efficiency and Privacy in Federated Thorax Disease Analysis

no code implementations22 Oct 2023 Ming Li, Guang Yang

Thorax disease analysis in large-scale, multi-centre, and multi-scanner settings is often limited by strict privacy policies.

Federated Learning Privacy Preserving

Exploiting User Comments for Early Detection of Fake News Prior to Users' Commenting

no code implementations16 Oct 2023 Qiong Nan, Qiang Sheng, Juan Cao, Yongchun Zhu, Danding Wang, Guang Yang, Jintao Li

To break such a dilemma, a feasible but not well-studied solution is to leverage social contexts (e. g., comments) from historical news for training a detection model and apply it to newly emerging news without social contexts.

Fake News Detection

High Accuracy and Cost-Saving Active Learning 3D WD-UNet for Airway Segmentation

no code implementations9 Oct 2023 Shiyi Wang, Yang Nan, Simon Walsh, Guang Yang

We propose a novel Deep Active Learning (DeepAL) model-3D Wasserstein Discriminative UNet (WD-UNet) for reducing the annotation effort of medical 3D Computed Tomography (CT) segmentation.

Active Learning Computed Tomography (CT) +1

T1/T2 relaxation temporal modelling from accelerated acquisitions using a Latent Transformer

no code implementations28 Sep 2023 Fanwen Wang, Michael Tanzer, Mengyun Qiao, Wenjia Bai, Daniel Rueckert, Guang Yang, Sonia Nielles-Vallespin

Quantitative cardiac magnetic resonance T1 and T2 mapping enable myocardial tissue characterisation but the lengthy scan times restrict their widespread clinical application.

Decoder

Post-COVID Highlights: Challenges and Solutions of AI Techniques for Swift Identification of COVID-19

no code implementations24 Sep 2023 Yingying Fang, Xiaodan Xing, Shiyi Wang, Simon Walsh, Guang Yang

Since the onset of the COVID-19 pandemic in 2019, there has been a concerted effort to develop cost-effective, non-invasive, and rapid AI-based tools.

SegmentAnything helps microscopy images based automatic and quantitative organoid detection and analysis

1 code implementation8 Sep 2023 Xiaodan Xing, Chunling Tang, Yunzhe Guo, Nicholas Kurniawan, Guang Yang

Organoids are self-organized 3D cell clusters that closely mimic the architecture and function of in vivo tissues and organs.

Drug Discovery

DMKD: Improving Feature-based Knowledge Distillation for Object Detection Via Dual Masking Augmentation

no code implementations6 Sep 2023 Guang Yang, Yin Tang, Zhijian Wu, Jun Li, Jianhua Xu, Xili Wan

Recent mainstream masked distillation methods function by reconstructing selectively masked areas of a student network from the feature map of its teacher counterpart.

Knowledge Distillation object-detection +1

Real-Time Non-Invasive Imaging and Detection of Spreading Depolarizations through EEG: An Ultra-Light Explainable Deep Learning Approach

no code implementations6 Sep 2023 Yinzhe Wu, Sharon Jewell, Xiaodan Xing, Yang Nan, Anthony J. Strong, Guang Yang, Martyn G. Boutelle

This study presented a novel ultra-light-weight multi-modal deep-learning network to fuse EEG spectrogram imaging and temporal power vectors to enhance SD identification accuracy over each single electrode, allowing flexible EEG map and paving the way for SD detection on ultra-low-density EEG with variable electrode positioning.

EEG

Multi-scale, Data-driven and Anatomically Constrained Deep Learning Image Registration for Adult and Fetal Echocardiography

1 code implementation2 Sep 2023 Md. Kamrul Hasan, Haobo Zhu, Guang Yang, Choon Hwai Yap

We propose a framework that combines three strategies for DLIR in both fetal and adult echo: (1) an anatomic shape-encoded loss to preserve physiological myocardial and left ventricular anatomical topologies in warped images; (2) a data-driven loss that is trained adversarially to preserve good image texture features in warped images; and (3) a multi-scale training scheme of a data-driven and anatomically constrained algorithm to improve accuracy.

Image Registration Motion Estimation +1

Video-Instrument Synergistic Network for Referring Video Instrument Segmentation in Robotic Surgery

no code implementations18 Aug 2023 Hongqiu Wang, Lei Zhu, Guang Yang, Yike Guo, Shichen Zhang, Bo Xu, Yueming Jin

Our method is verified on these datasets, and experimental results exhibit that the VIS-Net can significantly outperform existing state-of-the-art referring segmentation methods.

Robot Navigation Segmentation

One for Multiple: Physics-informed Synthetic Data Boosts Generalizable Deep Learning for Fast MRI Reconstruction

1 code implementation25 Jul 2023 Zi Wang, Xiaotong Yu, Chengyan Wang, Weibo Chen, Jiazheng Wang, Ying-Hua Chu, Hongwei Sun, Rushuai Li, Peiyong Li, Fan Yang, Haiwei Han, Taishan Kang, Jianzhong Lin, Chen Yang, Shufu Chang, Zhang Shi, Sha Hua, Yan Li, Juan Hu, Liuhong Zhu, Jianjun Zhou, Meijing Lin, Jiefeng Guo, Congbo Cai, Zhong Chen, Di Guo, Guang Yang, Xiaobo Qu

We demonstrate that training DL models on synthetic data, coupled with enhanced learning techniques, yields in vivo MRI reconstructions comparable to or surpassing those of models trained on matched realistic datasets, reducing the reliance on real-world MRI data by up to 96%.

Medical Diagnosis MRI Reconstruction

Is attention all you need in medical image analysis? A review

no code implementations24 Jul 2023 Giorgos Papanastasiou, Nikolaos Dikaios, Jiahao Huang, Chengjia Wang, Guang Yang

Attention and Transformer compartments (Transf/Attention) which can well maintain properties for modelling global relationships, have been proposed as lighter alternatives of full Transformers.

Medical Image Analysis

$\mathrm{SAM^{Med}}$: A medical image annotation framework based on large vision model

no code implementations11 Jul 2023 Chenglong Wang, Dexuan Li, Sucheng Wang, Chengxiu Zhang, Yida Wang, Yun Liu, Guang Yang

The $\mathrm{SAM^{assist}}$ demonstrates the generalization ability of SAM to the downstream medical segmentation task using the prompt-learning approach.

Image Segmentation Liver Segmentation +3

Enhancing Super-Resolution Networks through Realistic Thick-Slice CT Simulation

1 code implementation2 Jul 2023 Zeyu Tang, Xiaodan Xing, Guang Yang

Thus, we introduce a simple yet realistic method to generate thick CT images from thin-slice CT images, facilitating the creation of training pairs for SR algorithms.

Super-Resolution

CDiffMR: Can We Replace the Gaussian Noise with K-Space Undersampling for Fast MRI?

1 code implementation25 Jun 2023 Jiahao Huang, Angelica Aviles-Rivero, Carola-Bibiane Schönlieb, Guang Yang

Different from conventional diffusion models, the degradation operation of our CDiffMR is based on \textit{k}-space undersampling instead of adding Gaussian noise, and the restoration network is trained to harness a de-aliaseing function.

MRI Reconstruction

A Simple Data Augmentation for Feature Distribution Skewed Federated Learning

no code implementations14 Jun 2023 Yunlu Yan, Huazhu Fu, Yuexiang Li, Jinheng Xie, Jun Ma, Guang Yang, Lei Zhu

In this paper, we focus on the feature distribution skewed FL scenario, a common non-IID situation in real-world applications where data from different clients exhibit varying underlying distributions.

Data Augmentation Federated Learning

You Don't Have to Be Perfect to Be Amazing: Unveil the Utility of Synthetic Images

no code implementations25 May 2023 Xiaodan Xing, Federico Felder, Yang Nan, Giorgos Papanastasiou, Walsh Simon, Guang Yang

In addition, we have empirically demonstrated that the utility score does not require images with both high fidelity and high variety.

Data Augmentation Image Generation +1

ChatAgri: Exploring Potentials of ChatGPT on Cross-linguistic Agricultural Text Classification

1 code implementation24 May 2023 Biao Zhao, Weiqiang Jin, Javier Del Ser, Guang Yang

In the era of sustainable smart agriculture, a massive amount of agricultural news text is being posted on the Internet, in which massive agricultural knowledge has been accumulated.

text-classification Text Classification

Heterogeneous Directed Hypergraph Neural Network over abstract syntax tree (AST) for Code Classification

1 code implementation7 May 2023 Guang Yang, Tiancheng Jin, Liang Dou

In this study, we propose to represent AST as a heterogeneous directed hypergraph (HDHG) and process the graph by heterogeneous directed hypergraph neural network (HDHGN) for code classification.

Code Classification Graph Neural Network

The Beauty or the Beast: Which Aspect of Synthetic Medical Images Deserves Our Focus?

1 code implementation3 May 2023 Xiaodan Xing, Yang Nan, Federico Felder, Simon Walsh, Guang Yang

Training medical AI algorithms requires large volumes of accurately labeled datasets, which are difficult to obtain in the real world.

Deep Learning-based Diffusion Tensor Cardiac Magnetic Resonance Reconstruction: A Comparison Study

no code implementations31 Mar 2023 Jiahao Huang, Pedro F. Ferreira, Lichao Wang, Yinzhe Wu, Angelica I. Aviles-Rivero, Carola-Bibiane Schonlieb, Andrew D. Scott, Zohya Khalique, Maria Dwornik, Ramyah Rajakulasingam, Ranil De Silva, Dudley J. Pennell, Sonia Nielles-Vallespin, Guang Yang

Our results indicate that the models we discussed in this study can be applied for clinical use at an acceleration factor (AF) of $\times 2$ and $\times 4$, with the D5C5 model showing superior fidelity for reconstruction and the SwinMR model providing higher perceptual scores.

MRI Reconstruction

Less is More: Unsupervised Mask-guided Annotated CT Image Synthesis with Minimum Manual Segmentations

no code implementations19 Mar 2023 Xiaodan Xing, Giorgos Papanastasiou, Simon Walsh, Guang Yang

To address these issues, in this work, we propose a novel strategy for medical image synthesis, namely Unsupervised Mask (UM)-guided synthesis, to obtain both synthetic images and segmentations using limited manual segmentation labels.

Data Augmentation Image Generation +2

Diff-UNet: A Diffusion Embedded Network for Volumetric Segmentation

1 code implementation18 Mar 2023 Zhaohu Xing, Liang Wan, Huazhu Fu, Guang Yang, Lei Zhu

Our experimental results also indicate the universality and effectiveness of the proposed model.

Denoising Segmentation

Online Control Barrier Functions for Decentralized Multi-Agent Navigation

no code implementations8 Mar 2023 Zhan Gao, Guang Yang, Amanda Prorok

Control barrier functions (CBFs) enable guaranteed safe multi-agent navigation in the continuous domain.

Robot Navigation

A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuning

1 code implementation22 Feb 2023 Jin Zhu, Guang Yang, Pietro Lio

On the other hand, the segmentation-based perceptual loss increases $+0. 14$ dB PSNR on average for SOTA methods, including CNNs and vision transformers.

Image Segmentation Image Super-Resolution +2

AMD: Adaptive Masked Distillation for Object Detection

no code implementations31 Jan 2023 Guang Yang, Yin Tang, Jun Li, Jianhua Xu, Xili Wan

As a general model compression paradigm, feature-based knowledge distillation allows the student model to learn expressive features from the teacher counterpart.

Knowledge Distillation Model Compression +3

Hierarchical Perception Adversarial Learning Framework for Compressed Sensing MRI

no code implementations27 Jan 2023 Zhifan Gao, Yifeng Guo, Jiajing Zhang, Tieyong Zeng, Guang Yang

HP-ALF can perceive the image information in the hierarchical mechanism: image-level perception and patch-level perception.

ViGU: Vision GNN U-Net for Fast MRI

no code implementations23 Jan 2023 Jiahao Huang, Angelica Aviles-Rivero, Carola-Bibiane Schonlieb, Guang Yang

The majority of existing deep learning models, e. g., convolutional neural networks, work on data with Euclidean or regular grids structures.

Decoder

Is Autoencoder Truly Applicable for 3D CT Super-Resolution?

1 code implementation23 Jan 2023 Weixun Luo, Xiaodan Xing, Guang Yang

Our work is the first comparative study investigating the suitability of AE architecture for 3D CT SISR tasks and brings a rationale for researchers to re-think the choice of model architectures especially for 3D CT SISR tasks.

Image Super-Resolution Medical Image Analysis

Video Event Extraction via Tracking Visual States of Arguments

no code implementations3 Nov 2022 Guang Yang, Manling Li, Jiajie Zhang, Xudong Lin, Shih-Fu Chang, Heng Ji

Video event extraction aims to detect salient events from a video and identify the arguments for each event as well as their semantic roles.

Event Extraction

Deep Kronecker Network

no code implementations24 Oct 2022 Long Feng, Guang Yang

As such, we propose DKN, that is able to i) adapt to low sample size limitation, ii) provide desired model interpretation, and iii) achieve the prediction power as CNN.

regression

Adversarial Transformer for Repairing Human Airway Segmentation

no code implementations21 Oct 2022 Zeyu Tang, Nan Yang, Simon Walsh, Guang Yang

Discontinuity in the delineation of peripheral bronchioles hinders the potential clinical application of automated airway segmentation models.

Segmentation

Review of data types and model dimensionality for cardiac DTI SMS-related artefact removal

1 code implementation20 Sep 2022 Michael Tanzer, Sea Hee Yook, Guang Yang, Daniel Rueckert, Sonia Nielles-Vallespin

As diffusion tensor imaging (DTI) gains popularity in cardiac imaging due to its unique ability to non-invasively assess the cardiac microstructure, deep learning-based Artificial Intelligence is becoming a crucial tool in mitigating some of its drawbacks, such as the long scan times.

Multi-Modal Experience Inspired AI Creation

1 code implementation2 Sep 2022 Qian Cao, Xu Chen, Ruihua Song, Hao Jiang, Guang Yang, Zhao Cao

To model such human capabilities, in this paper, we define and solve a novel AI creation problem based on human experiences.

Multimodal Deep Learning Text Generation

Delving into the Frequency: Temporally Consistent Human Motion Transfer in the Fourier Space

no code implementations1 Sep 2022 Guang Yang, Wu Liu, Xinchen Liu, Xiaoyan Gu, Juan Cao, Jintao Li

To close the frequency gap between the natural and synthetic videos, we propose a novel Frequency-based human MOtion TRansfer framework, named FreMOTR, which can effectively mitigate the spatial artifacts and the temporal inconsistency of the synthesized videos.

DeepFake Detection Face Swapping

A survey, review, and future trends of skin lesion segmentation and classification

no code implementations25 Aug 2022 Md. Kamrul Hasan, Md. Asif Ahamad, Choon Hwai Yap, Guang Yang

The Computer-aided Diagnosis or Detection (CAD) approach for skin lesion analysis is an emerging field of research that has the potential to alleviate the burden and cost of skin cancer screening.

Lesion Classification Lesion Segmentation +2

Unsupervised Tissue Segmentation via Deep Constrained Gaussian Network

no code implementations4 Aug 2022 Yang Nan, Peng Tang, Guyue Zhang, Caihong Zeng, Zhihong Liu, Zhifan Gao, Heye Zhang, Guang Yang

However, most machine and deep learning based approaches are supervised and developed using a large number of training samples, in which the pixelwise annotations are expensive and sometimes can be impossible to obtain.

Segmentation

A Novel Automated Classification and Segmentation for COVID-19 using 3D CT Scans

no code implementations4 Aug 2022 Shiyi Wang, Guang Yang

Medical image classification and segmentation based on deep learning (DL) are emergency research topics for diagnosing variant viruses of the current COVID-19 situation.

Computed Tomography (CT) Image Classification +4

Large-Kernel Attention for 3D Medical Image Segmentation

no code implementations19 Jul 2022 Hao Li, Yang Nan, Javier Del Ser, Guang Yang

The performance improvement due to the proposed LK attention module was also statistically validated.

Computed Tomography (CT) Image Segmentation +4

Human Treelike Tubular Structure Segmentation: A Comprehensive Review and Future Perspectives

no code implementations12 Jul 2022 Hao Li, Zeyu Tang, Yang Nan, Guang Yang

Various structures in human physiology follow a treelike morphology, which often expresses complexity at very fine scales.

Computed Tomography (CT)

Explainable AI (XAI) in Biomedical Signal and Image Processing: Promises and Challenges

no code implementations9 Jul 2022 Guang Yang, Arvind Rao, Christine Fernandez-Maloigne, Vince Calhoun, Gloria Menegaz

This paper aims at providing an overview on XAI in biomedical data processing and points to an upcoming Special Issue on Deep Learning in Biomedical Image and Signal Processing of the IEEE Signal Processing Magazine that is going to appear in March 2022.

Deep Learning Explainable Artificial Intelligence (XAI)

Swin Deformable Attention U-Net Transformer (SDAUT) for Explainable Fast MRI

1 code implementation5 Jul 2022 Jiahao Huang, Xiaodan Xing, Zhifan Gao, Guang Yang

The main obstacle is the computational cost of the self-attention layer, which is the core part of the Transformer, can be expensive for high resolution MRI inputs.

Medical Image Analysis

Faster Diffusion Cardiac MRI with Deep Learning-based breath hold reduction

no code implementations21 Jun 2022 Michael Tanzer, Pedro Ferreira, Andrew Scott, Zohya Khalique, Maria Dwornik, Dudley Pennell, Guang Yang, Daniel Rueckert, Sonia Nielles-Vallespin

Diffusion Tensor Cardiac Magnetic Resonance (DT-CMR) enables us to probe the microstructural arrangement of cardiomyocytes within the myocardium in vivo and non-invasively, which no other imaging modality allows.

Ensemble Learning

CS$^2$: A Controllable and Simultaneous Synthesizer of Images and Annotations with Minimal Human Intervention

1 code implementation20 Jun 2022 Xiaodan Xing, Jiahao Huang, Yang Nan, Yinzhe Wu, Chengjia Wang, Zhifan Gao, Simon Walsh, Guang Yang

The destitution of image data and corresponding expert annotations limit the training capacities of AI diagnostic models and potentially inhibit their performance.

Image Generation Segmentation

Towards Reliable and Explainable AI Model for Solid Pulmonary Nodule Diagnosis

no code implementations8 Apr 2022 Chenglong Wang, Yun Liu, Fen Wang, Chengxiu Zhang, Yida Wang, Mei Yuan, Guang Yang

However, detection and accurate diagnosis of pulmonary nodules depend heavily on the experiences of radiologists and can be a heavy workload for them.

Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and Methodologies from CNN, GAN to Attention and Transformers

no code implementations1 Apr 2022 Jiahao Huang, Yingying Fang, Yang Nan, Huanjun Wu, Yinzhe Wu, Zhifan Gao, Yang Li, Zidong Wang, Pietro Lio, Daniel Rueckert, Yonina C. Eldar, Guang Yang

Research studies have shown no qualms about using data driven deep learning models for downstream tasks in medical image analysis, e. g., anatomy segmentation and lesion detection, disease diagnosis and prognosis, and treatment planning.

Anatomy Deep Learning +5

ME-Net: Multi-Encoder Net Framework for Brain Tumor Segmentation

no code implementations21 Mar 2022 Wenbo Zhang, Guang Yang, He Huang, Weiji Yang, Xiaomei Xu, Yongkai Liu, Xiaobo Lai

Moreover, the serious voxel imbalance between the brain tumor and the background as well as the different sizes and locations of the brain tumor makes the segmentation of 3D images a challenging problem.

Brain Tumor Segmentation Decoder +2

DRAG: Dynamic Region-Aware GCN for Privacy-Leaking Image Detection

1 code implementation17 Mar 2022 Guang Yang, Juan Cao, Qiang Sheng, Peng Qi, Xirong Li, Jintao Li

However, these methods have two limitations: 1) they neglect other important elements like scenes, textures, and objects beyond the capacity of pretrained object detectors; 2) the correlation among objects is fixed, but a fixed correlation is not appropriate for all the images.

Automatic Fine-grained Glomerular Lesion Recognition in Kidney Pathology

no code implementations11 Mar 2022 Yang Nan, Fengyi Li, Peng Tang, Guyue Zhang, Caihong Zeng, Guotong Xie, Zhihong Liu, Guang Yang

Recognition of glomeruli lesions is the key for diagnosis and treatment planning in kidney pathology; however, the coexisting glomerular structures such as mesangial regions exacerbate the difficulties of this task.

Fine-Grained Image Classification whole slide images

HDL: Hybrid Deep Learning for the Synthesis of Myocardial Velocity Maps in Digital Twins for Cardiac Analysis

2 code implementations9 Mar 2022 Xiaodan Xing, Javier Del Ser, Yinzhe Wu, Yang Li, Jun Xia, Lei Xu, David Firmin, Peter Gatehouse, Guang Yang

A core part of digital healthcare twins is model-based data synthesis, which permits the generation of realistic medical signals without requiring to cope with the modelling complexity of anatomical and biochemical phenomena producing them in reality.

Decision Making Generative Adversarial Network +1

Unsupervised Image Registration Towards Enhancing Performance and Explainability in Cardiac And Brain Image Analysis

no code implementations7 Mar 2022 Chengjia Wang, Guang Yang, Giorgos Papanastasiou

Moreover, inverse-consistency is a fundamental inter-modality registration property that is not considered in deep learning registration algorithms.

Image Generation Medical Image Analysis +1