Search Results for author: Sibo Cheng

Found 16 papers, 5 papers with code

Multi-fidelity physics constrained neural networks for dynamical systems

no code implementations3 Feb 2024 Hao Zhou, Sibo Cheng, Rossella Arcucci

As a result, during the training of predictive models, physical constraints can be evaluated within low-fidelity spaces, yielding a trade-off between training efficiency and accuracy.

Freeze the backbones: A Parameter-Efficient Contrastive Approach to Robust Medical Vision-Language Pre-training

no code implementations2 Jan 2024 Jiuming Qin, Che Liu, Sibo Cheng, Yike Guo, Rossella Arcucci

Modern healthcare often utilises radiographic images alongside textual reports for diagnostics, encouraging the use of Vision-Language Self-Supervised Learning (VL-SSL) with large pre-trained models to learn versatile medical vision representations.

Image Classification Image Segmentation +5

G2D: From Global to Dense Radiography Representation Learning via Vision-Language Pre-training

no code implementations3 Dec 2023 Che Liu, Cheng Ouyang, Sibo Cheng, Anand Shah, Wenjia Bai, Rossella Arcucci

G2D achieves superior performance across 6 medical imaging tasks and 25 diseases, particularly in semantic segmentation, which necessitates fine-grained, semantically-grounded image features.

object-detection Object Detection +5

Efficient deep data assimilation with sparse observations and time-varying sensors

1 code implementation24 Oct 2023 Sibo Cheng, Che Liu, Yike Guo, Rossella Arcucci

We introduce a novel variational DA scheme, named Voronoi-tessellation Inverse operator for VariatIonal Data assimilation (VIVID), that incorporates a DL inverse operator into the assimilation objective function.

IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-training

no code implementations11 Oct 2023 Che Liu, Sibo Cheng, Miaojing Shi, Anand Shah, Wenjia Bai, Rossella Arcucci

The framework derives multi-level visual features from the chest X-ray (CXR) images and separately aligns these features with the descriptive and the conclusive text encoded in the hierarchical medical report.

Contrastive Learning Descriptive

ETP: Learning Transferable ECG Representations via ECG-Text Pre-training

no code implementations6 Sep 2023 Che Liu, Zhongwei Wan, Sibo Cheng, Mi Zhang, Rossella Arcucci

In the domain of cardiovascular healthcare, the Electrocardiogram (ECG) serves as a critical, non-invasive diagnostic tool.

Language Modelling Representation Learning +2

A generative model for surrogates of spatial-temporal wildfire nowcasting

no code implementations5 Aug 2023 Sibo Cheng, Yike Guo, Rossella Arcucci

The model is tested in the ecoregion of a recent massive wildfire event in California, known as the Chimney fire.

Temporal Sequences

M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimization

1 code implementation17 Jul 2023 Che Liu, Sibo Cheng, Chen Chen, Mengyun Qiao, Weitong Zhang, Anand Shah, Wenjia Bai, Rossella Arcucci

The proposed method, named Medical vision-language pre-training with Frozen language models and Latent spAce Geometry optimization (M-FLAG), leverages a frozen language model for training stability and efficiency and introduces a novel orthogonality loss to harmonize the latent space geometry.

Image Classification Language Modelling +3

Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentation

no code implementations7 Jun 2023 Yinda Chen, Che Liu, Wei Huang, Sibo Cheng, Rossella Arcucci, Zhiwei Xiong

To address these challenges, we present Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentation (GTGM), a framework that extends of VLP to 3D medical images without relying on paired textual descriptions.

Computed Tomography (CT) Contrastive Learning +4

Med-UniC: Unifying Cross-Lingual Medical Vision-Language Pre-Training by Diminishing Bias

1 code implementation NeurIPS 2023 Zhongwei Wan, Che Liu, Mi Zhang, Jie Fu, Benyou Wang, Sibo Cheng, Lei Ma, César Quilodrán-Casas, Rossella Arcucci

Med-UniC reaches superior performance across 5 medical image tasks and 10 datasets encompassing over 30 diseases, offering a versatile framework for unifying multi-modal medical data within diverse linguistic communities.

Disentanglement

Frozen Language Model Helps ECG Zero-Shot Learning

no code implementations22 Mar 2023 Jun Li, Che Liu, Sibo Cheng, Rossella Arcucci, Shenda Hong

In downstream classification tasks, METS achieves around 10% improvement in performance without using any annotated data via zero-shot classification, compared to other supervised and SSL baselines that rely on annotated data.

Language Modelling Self-Supervised Learning +1

Spectral Cross-Domain Neural Network with Soft-adaptive Threshold Spectral Enhancement

1 code implementation10 Jan 2023 Che Liu, Sibo Cheng, Weiping Ding, Rossella Arcucci

The robust performance of SCDNN provides a new perspective to exploit knowledge across deep learning models from time and spectral domains.

Electrocardiography (ECG) Feature Engineering +1

Generalised Latent Assimilation in Heterogeneous Reduced Spaces with Machine Learning Surrogate Models

no code implementations7 Apr 2022 Sibo Cheng, Jianhua Chen, Charitos Anastasiou, Panagiota Angeli, Omar K. Matar, Yi-Ke Guo, Christopher C. Pain, Rossella Arcucci

The new approach is tested on a high-dimensional CFD application of a two-phase liquid flow with non-linear observation operators that current Latent Assimilation methods can not handle.

BIG-bench Machine Learning

Observation Error Covariance Specification in Dynamical Systems for Data assimilation using Recurrent Neural Networks

no code implementations11 Nov 2021 Sibo Cheng, Mingming Qiu

In this work, we propose a data-driven approach based on long short term memory (LSTM) recurrent neural networks (RNN) to improve both the accuracy and the efficiency of observation covariance specification in data assimilation for dynamical systems.

Computational Efficiency Time Series +1

Cannot find the paper you are looking for? You can Submit a new open access paper.