Search Results for author: Dong Ni

Found 69 papers, 24 papers with code

LUM-ViT: Learnable Under-sampling Mask Vision Transformer for Bandwidth Limited Optical Signal Acquisition

1 code implementation3 Mar 2024 Lingfeng Liu, Dong Ni, Hangjie Yuan

To tackle this hurdle, we introduce a novel approach leveraging pre-acquisition modulation to reduce the acquisition volume.

Binarization

Thyroid ultrasound diagnosis improvement via multi-view self-supervised learning and two-stage pre-training

no code implementations18 Feb 2024 Jian Wang, Xin Yang, Xiaohong Jia, Wufeng Xue, Rusi Chen, Yanlin Chen, Xiliang Zhu, Lian Liu, Yan Cao, Jianqiao Zhou, Dong Ni, Ning Gu

In this study, we proposed a multi-view contrastive self-supervised method to improve thyroid nodule classification and segmentation performance with limited manual labels.

Classification Segmentation +1

One-Stop Automated Diagnostic System for Carpal Tunnel Syndrome in Ultrasound Images Using Deep Learning

no code implementations8 Feb 2024 Jiayu Peng, Jiajun Zeng, Manlin Lai, Ruobing Huang, Dong Ni, Zhenzhou Li

In the reader study, it demonstrated comparable performance with the average performance of the experienced in classifying the CTS, while outperformed that of the inexperienced radiologists in terms of classification metrics (e. g., accuracy score of 3. 59% higher and F1 score of 5. 85% higher).

InstructVideo: Instructing Video Diffusion Models with Human Feedback

1 code implementation19 Dec 2023 Hangjie Yuan, Shiwei Zhang, Xiang Wang, Yujie Wei, Tao Feng, Yining Pan, Yingya Zhang, Ziwei Liu, Samuel Albanie, Dong Ni

To tackle this problem, we propose InstructVideo to instruct text-to-video diffusion models with human feedback by reward fine-tuning.

Video Generation

From Denoising Training to Test-Time Adaptation: Enhancing Domain Generalization for Medical Image Segmentation

1 code implementation31 Oct 2023 Ruxue Wen, Hangjie Yuan, Dong Ni, Wenbo Xiao, Yaoyao Wu

In medical image segmentation, domain generalization poses a significant challenge due to domain shifts caused by variations in data acquisition devices and other factors.

Denoising Domain Generalization +5

FetusMapV2: Enhanced Fetal Pose Estimation in 3D Ultrasound

no code implementations30 Oct 2023 Chaoyu Chen, Xin Yang, Yuhao Huang, Wenlong Shi, Yan Cao, Mingyuan Luo, Xindi Hu, Lei Zhue, Lequan Yu, Kejuan Yue, Yuanji Zhang, Yi Xiong, Dong Ni, Weijun Huang

However, accurately estimating the 3D fetal pose in US volume has several challenges, including poor image quality, limited GPU memory for tackling high dimensional data, symmetrical or ambiguous anatomical structures, and considerable variations in fetal poses.

Pose Estimation Self-Supervised Learning

FFPN: Fourier Feature Pyramid Network for Ultrasound Image Segmentation

no code implementations26 Aug 2023 Chaoyu Chen, Xin Yang, Rusi Chen, Junxuan Yu, Liwei Du, Jian Wang, Xindi Hu, Yan Cao, Yingying Liu, Dong Ni

In this paper, we introduce a novel Fourier-anchor-based DTS framework called Fourier Feature Pyramid Network (FFPN) to address the aforementioned issues.

Image Segmentation Semantic Segmentation

PE-MED: Prompt Enhancement for Interactive Medical Image Segmentation

no code implementations26 Aug 2023 Ao Chang, Xing Tao, Xin Yang, Yuhao Huang, Xinrui Zhou, Jiajun Zeng, Ruobing Huang, Dong Ni

It can prevent the highly unfavorable scenarios, such as encountering a blank mask as the initial input after the first interaction.

Image Segmentation Medical Image Segmentation +3

RLIPv2: Fast Scaling of Relational Language-Image Pre-training

3 code implementations ICCV 2023 Hangjie Yuan, Shiwei Zhang, Xiang Wang, Samuel Albanie, Yining Pan, Tao Feng, Jianwen Jiang, Dong Ni, Yingya Zhang, Deli Zhao

In this paper, we propose RLIPv2, a fast converging model that enables the scaling of relational pre-training to large-scale pseudo-labelled scene graph data.

 Ranked #1 on Zero-Shot Human-Object Interaction Detection on HICO-DET (using extra training data)

Graph Generation Human-Object Interaction Detection +6

OnUVS: Online Feature Decoupling Framework for High-Fidelity Ultrasound Video Synthesis

no code implementations16 Aug 2023 Han Zhou, Dong Ni, Ao Chang, Xinrui Zhou, Rusi Chen, Yanlin Chen, Lian Liu, Jiamin Liang, Yuhao Huang, Tong Han, Zhe Liu, Deng-Ping Fan, Xin Yang

Second, to better preserve the integrity and textural information of US images, we implemented a dual-decoder that decouples the content and textural features in the generator.

Semi-Supervised Dual-Stream Self-Attentive Adversarial Graph Contrastive Learning for Cross-Subject EEG-based Emotion Recognition

no code implementations13 Aug 2023 Weishan Ye, Zhiguo Zhang, Min Zhang, Fei Teng, Li Zhang, Linling Li, Gan Huang, Jianhong Wang, Dong Ni, Zhen Liang

In this paper, a semi-supervised Dual-stream Self-Attentive Adversarial Graph Contrastive learning framework (termed as DS-AGC) is proposed to tackle the challenge of limited labeled data in cross-subject EEG-based emotion recognition.

Contrastive Learning Domain Adaptation +2

MUVF-YOLOX: A Multi-modal Ultrasound Video Fusion Network for Renal Tumor Diagnosis

1 code implementation15 Jul 2023 Junyu Li, Han Huang, Dong Ni, Wufeng Xue, Dongmei Zhu, Jun Cheng

In addition, we design an object-level temporal aggregation (OTA) module that can automatically filter low-quality features and efficiently integrate temporal information from multiple frames to improve the accuracy of tumor diagnosis.

Video Classification

Multi-IMU with Online Self-Consistency for Freehand 3D Ultrasound Reconstruction

no code implementations28 Jun 2023 Mingyuan Luo, Xin Yang, Zhongnuo Yan, Junyu Li, Yuanji Zhang, Jiongquan Chen, Xindi Hu, Jikuan Qian, Jun Cheng, Dong Ni

Ultrasound (US) imaging is a popular tool in clinical diagnosis, offering safety, repeatability, and real-time capabilities.

GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration

1 code implementation26 Jun 2023 Haoran Dou, Ning Bi, Luyi Han, Yuhao Huang, Ritse Mann, Xin Yang, Dong Ni, Nishant Ravikumar, Alejandro F. Frangi, Yunzhi Huang

In this study, we construct a registration model based on the gradient surgery mechanism, named GSMorph, to achieve a hyperparameter-free balance on multiple losses.

ModeT: Learning Deformable Image Registration via Motion Decomposition Transformer

1 code implementation9 Jun 2023 Haiqiao Wang, Dong Ni, Yi Wang

The Transformer structures have been widely used in computer vision and have recently made an impact in the area of medical image registration.

Image Registration Medical Image Registration

Instructive Feature Enhancement for Dichotomous Medical Image Segmentation

1 code implementation6 Jun 2023 Lian Liu, Han Zhou, Jiongquan Chen, Sijing Liu, Wenlong Shi, Dong Ni, Deng-Ping Fan, Xin Yang

Deep neural networks have been widely applied in dichotomous medical image segmentation (DMIS) of many anatomical structures in several modalities, achieving promising performance.

Image Segmentation Medical Image Segmentation +2

Fourier Test-time Adaptation with Multi-level Consistency for Robust Classification

no code implementations5 Jun 2023 Yuhao Huang, Xin Yang, Xiaoqiong Huang, Xinrui Zhou, Haozhe Chi, Haoran Dou, Xindi Hu, Jian Wang, Xuedong Deng, Dong Ni

Second, we introduce a regularization technique that utilizes style interpolation consistency in the frequency space to encourage self-consistency in the logit space of the model output.

Robust classification Test-time Adaptation

Inflated 3D Convolution-Transformer for Weakly-supervised Carotid Stenosis Grading with Ultrasound Videos

1 code implementation5 Jun 2023 Xinrui Zhou, Yuhao Huang, Wufeng Xue, Xin Yang, Yuxin Zou, Qilong Ying, Yuanji Zhang, Jia Liu, Jie Ren, Dong Ni

First, to avoid the requirement of laborious and unreliable annotation, we propose a novel and effective video classification network for weakly-supervised CSG.

Video Classification

Segment Anything Model for Medical Images?

1 code implementation28 Apr 2023 Yuhao Huang, Xin Yang, Lian Liu, Han Zhou, Ao Chang, Xinrui Zhou, Rusi Chen, Junxuan Yu, Jiongquan Chen, Chaoyu Chen, Sijing Liu, Haozhe Chi, Xindi Hu, Kejuan Yue, Lei LI, Vicente Grau, Deng-Ping Fan, Fajin Dong, Dong Ni

To fully validate SAM's performance on medical data, we collected and sorted 53 open-source datasets and built a large medical segmentation dataset with 18 modalities, 84 objects, 125 object-modality paired targets, 1050K 2D images, and 6033K masks.

Image Segmentation Medical Image Segmentation +3

Hierarchical Agent-based Reinforcement Learning Framework for Automated Quality Assessment of Fetal Ultrasound Video

no code implementations14 Apr 2023 Sijing Liu, Qilong Ying, Shuangchi He, Xin Yang, Dong Ni, Ruobing Huang

Ultrasound is the primary modality to examine fetal growth during pregnancy, while the image quality could be affected by various factors.

Non-Iterative Scribble-Supervised Learning with Pacing Pseudo-Masks for Medical Image Segmentation

1 code implementation20 Oct 2022 Zefan Yang, Di Lin, Dong Ni, Yi Wang

To address these issues, we propose a non-iterative method where a stream of varying (pacing) pseudo-masks teach a network via consistency training, named PacingPseudo.

Image Segmentation Medical Image Segmentation +2

RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detection

3 code implementations5 Sep 2022 Hangjie Yuan, Jianwen Jiang, Samuel Albanie, Tao Feng, Ziyuan Huang, Dong Ni, Mingqian Tang

The task of Human-Object Interaction (HOI) detection targets fine-grained visual parsing of humans interacting with their environment, enabling a broad range of applications.

Human-Object Interaction Detection Relation +1

Multi-Attribute Attention Network for Interpretable Diagnosis of Thyroid Nodules in Ultrasound Images

no code implementations9 Jul 2022 Van T. Manh, Jianqiao Zhou, Xiaohong Jia, Zehui Lin, Wenwen Xu, Zihan Mei, Yijie Dong, Xin Yang, Ruobing Huang, Dong Ni

To overcome this, we propose a novel deep learning framework called multi-attribute attention network (MAA-Net) that is designed to mimic the clinical diagnosis process.

Attribute

Fine-grained Correlation Loss for Regression

no code implementations1 Jul 2022 Chaoyu Chen, Xin Yang, Ruobing Huang, Xindi Hu, Yankai Huang, Xiduo Lu, Xinrui Zhou, Mingyuan Luo, Yinyu Ye, Xue Shuang, Juzheng Miao, Yi Xiong, Dong Ni

In this work, we propose to revisit the classic regression tasks with novel investigations on directly optimizing the fine-grained correlation losses.

Attribute Image Quality Assessment +3

Weakly-supervised High-fidelity Ultrasound Video Synthesis with Feature Decoupling

no code implementations1 Jul 2022 Jiamin Liang, Xin Yang, Yuhao Huang, Kai Liu, Xinrui Zhou, Xindi Hu, Zehui Lin, Huanjia Luo, Yuanji Zhang, Yi Xiong, Dong Ni

First, leveraging the advantages of self- and fully-supervised learning, our proposed system is trained in weakly-supervised manner for keypoint detection.

Keypoint Detection Vocal Bursts Intensity Prediction

Personalized Diagnostic Tool for Thyroid Cancer Classification using Multi-view Ultrasound

no code implementations1 Jul 2022 Han Huang, Yijie Dong, Xiaohong Jia, Jianqiao Zhou, Dong Ni, Jun Cheng, Ruobing Huang

Furthermore, finding an optimal way to integrate multi-view information also relies on the experience of clinicians and adds further difficulty to accurate diagnosis.

Decision Making

HASA: Hybrid Architecture Search with Aggregation Strategy for Echinococcosis Classification and Ovary Segmentation in Ultrasound Images

no code implementations14 Apr 2022 Jikuan Qian, Rui Li, Xin Yang, Yuhao Huang, Mingyuan Luo, Zehui Lin, Wenhui Hong, Ruobing Huang, Haining Fan, Dong Ni, Jun Cheng

The hybrid framework consists of a pre-trained backbone and several searched cells (i. e., network building blocks), which takes advantage of the strengths of both NAS and the expert knowledge from existing convolutional neural networks.

Image Classification Neural Architecture Search +1

Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesis

no code implementations14 Apr 2022 Jiamin Liang, Xin Yang, Yuhao Huang, Haoming Li, Shuangchi He, Xindi Hu, Zejian Chen, Wufeng Xue, Jun Cheng, Dong Ni

Our main contributions include: 1) we present the first work that can synthesize realistic B-mode US images with high-resolution and customized texture editing features; 2) to enhance structural details of generated images, we propose to introduce auxiliary sketch guidance into a conditional GAN.

Generative Adversarial Network Image Generation

Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics

1 code implementation1 Feb 2022 Hangjie Yuan, Mang Wang, Dong Ni, Liangpeng Xu

Specifically, We propose to utilize a Verb Semantic Model (VSM) and use semantic aggregation to profit from this object-guided hierarchy.

Human-Object Interaction Detection Object +2

AWSnet: An Auto-weighted Supervision Attention Network for Myocardial Scar and Edema Segmentation in Multi-sequence Cardiac Magnetic Resonance Images

1 code implementation14 Jan 2022 Kai-Ni Wang, Xin Yang, Juzheng Miao, Lei LI, Jing Yao, Ping Zhou, Wufeng Xue, Guang-Quan Zhou, Xiahai Zhuang, Dong Ni

Extensive experimental results on a publicly available dataset from Myocardial pathology segmentation combining multi-sequence CMR (MyoPS 2020) demonstrate our method can achieve promising performance compared with other state-of-the-art methods.

Segmentation

Recurrent Feature Propagation and Edge Skip-Connections for Automatic Abdominal Organ Segmentation

no code implementations2 Jan 2022 Zefan Yang, Di Lin, Dong Ni, Yi Wang

Automatic segmentation of abdominal organs in computed tomography (CT) images can support radiation therapy and image-guided surgery workflows.

Computed Tomography (CT) Organ Segmentation +2

Generalizable Cross-modality Medical Image Segmentation via Style Augmentation and Dual Normalization

1 code implementation CVPR 2022 Ziqi Zhou, Lei Qi, Xin Yang, Dong Ni, Yinghuan Shi

For medical image segmentation, imagine if a model was only trained using MR images in source domain, how about its performance to directly segment CT images in target domain?

Domain Generalization Image Segmentation +3

Image-Guided Navigation of a Robotic Ultrasound Probe for Autonomous Spinal Sonography Using a Shadow-aware Dual-Agent Framework

no code implementations3 Nov 2021 Keyu Li, Yangxin Xu, Jian Wang, Dong Ni, Li Liu, Max Q. -H. Meng

Ultrasound (US) imaging is commonly used to assist in the diagnosis and interventions of spine diseases, while the standardized US acquisitions performed by manually operating the probe require substantial experience and training of sonographers.

Anatomy Decision Making +2

Spatio-Temporal Dynamic Inference Network for Group Activity Recognition

2 code implementations ICCV 2021 Hangjie Yuan, Dong Ni, Mang Wang

Within each interaction field, we apply DR to predict the relation matrix and DW to predict the dynamic walk offsets in a joint-processing manner, thus forming a person-specific interaction graph.

Group Activity Recognition Relation

Bootstrap Representation Learning for Segmentation on Medical Volumes and Sequences

no code implementations23 Jun 2021 Zejian Chen, Wei Zhuo, Tianfu Wang, Wufeng Xue, Dong Ni

Based on the continuity between slices/frames and the common spatial layout of organs across volumes/sequences, we introduced a novel bootstrap self-supervised representation learning method by leveraging the predictable possibility of neighboring slices.

Representation Learning Self-Supervised Learning

Joint Landmark and Structure Learning for Automatic Evaluation of Developmental Dysplasia of the Hip

no code implementations10 Jun 2021 Xindi Hu, LiMin Wang, Xin Yang, Xu Zhou, Wufeng Xue, Yan Cao, Shengfeng Liu, Yuhao Huang, Shuangping Guo, Ning Shang, Dong Ni, Ning Gu

In this study, we propose a multi-task framework to learn the relationships among landmarks and structures jointly and automatically evaluate DDH.

Style-invariant Cardiac Image Segmentation with Test-time Augmentation

no code implementations24 Sep 2020 Xiaoqiong Huang, Zejian Chen, Xin Yang, Zhendong Liu, Yuxin Zou, Mingyuan Luo, Wufeng Xue, Dong Ni

Based on the zero-shot style transfer to remove appearance shift and test-time augmentation to explore diverse underlying anatomy, our proposed method is effective in combating the appearance shift.

Anatomy Cardiac Segmentation +5

Computer-aided Tumor Diagnosis in Automated Breast Ultrasound using 3D Detection Network

no code implementations31 Jul 2020 Junxiong Yu, Chaoyu Chen, Xin Yang, Yi Wang, Dan Yan, Jianxing Zhang, Dong Ni

The efficacy of our network is verified from a collected dataset of 418 patients with 145 benign tumors and 273 malignant tumors.

Breast Cancer Detection Classification +1

A Deep Attentive Convolutional Neural Network for Automatic Cortical Plate Segmentation in Fetal MRI

2 code implementations27 Apr 2020 Haoran Dou, Davood Karimi, Caitlin K. Rollins, Cynthia M. Ortinau, Lana Vasung, Clemente Velasco-Annis, Abdelhakim Ouaalam, Xin Yang, Dong Ni, Ali Gholipour

Automatic segmentation of the cortical plate, on the other hand, is challenged by the relatively low resolution of the reconstructed fetal brain MRI scans compared to the thin structure of the cortical plate, partial voluming, and the wide range of variations in the morphology of the cortical plate as the brain matures during gestation.

Segmentation

Agent with Warm Start and Active Termination for Plane Localization in 3D Ultrasound

1 code implementation10 Oct 2019 Haoran Dou, Xin Yang, Jikuan Qian, Wufeng Xue, Hao Qin, Xu Wang, Lequan Yu, Shujun Wang, Yi Xiong, Pheng-Ann Heng, Dong Ni

In this study, we propose a novel reinforcement learning (RL) framework to automatically localize fetal brain standard planes in 3D US.

Reinforcement Learning (RL)

Joint Segmentation and Landmark Localization of Fetal Femur in Ultrasound Volumes

no code implementations31 Aug 2019 Xu Wang, Xin Yang, Haoran Dou, Shengli Li, Pheng-Ann Heng, Dong Ni

In this paper, we propose an effective framework for simultaneous segmentation and landmark localization in prenatal ultrasound volumes.

Segmentation

Segmentation of Multimodal Myocardial Images Using Shape-Transfer GAN

no code implementations14 Aug 2019 Xumin Tao, Hongrong Wei, Wufeng Xue, Dong Ni

Myocardium segmentation of late gadolinium enhancement (LGE) Cardiac MR images is important for evaluation of infarction regions in clinical practice.

Myocardium Segmentation Segmentation

Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound

1 code implementation3 Jul 2019 Yi Wang, Haoran Dou, Xiao-Wei Hu, Lei Zhu, Xin Yang, Ming Xu, Jing Qin, Pheng-Ann Heng, Tianfu Wang, Dong Ni

Our attention module utilizes the attention mechanism to selectively leverage the multilevel features integrated from different layers to refine the features at each individual layer, suppressing the non-prostate noise at shallow layers of the CNN and increasing more prostate details into features at deep layers.

Image Segmentation Medical Image Segmentation +2

Fine-grained Recurrent Neural Networks for Automatic Prostate Segmentation in Ultrasound Images

no code implementations6 Dec 2016 Xin Yang, Lequan Yu, Lingyun Wu, Yi Wang, Dong Ni, Jing Qin, Pheng-Ann Heng

Additionally, our approach is general and can be extended to other medical image segmentation tasks, where boundary incompleteness is one of the main challenges.

Image Segmentation Medical Image Segmentation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.