Search Results for author: Xin Yang

Found 184 papers, 67 papers with code

Automatic 3D Cardiovascular MR Segmentation with Densely-Connected Volumetric ConvNets

2 code implementations2 Aug 2017 Lequan Yu, Jie-Zhi Cheng, Qi Dou, Xin Yang, Hao Chen, Jing Qin, Pheng-Ann Heng

Second, it avoids learning redundant feature maps by encouraging feature reuse and hence requires fewer parameters to achieve high performance, which is essential for medical applications with limited training data.

DPAUC: Differentially Private AUC Computation in Federated Learning

1 code implementation25 Aug 2022 Jiankai Sun, Xin Yang, Yuanshun Yao, Junyuan Xie, Di wu, Chong Wang

Federated learning (FL) has gained significant attention recently as a privacy-enhancing tool to jointly train a machine learning model by multiple participants.

Federated Learning

LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matching

1 code implementation19 Nov 2023 Yixun Liang, Xin Yang, Jiantao Lin, Haodong Li, Xiaogang Xu, Yingcong Chen

The recent advancements in text-to-3D generation mark a significant milestone in generative models, unlocking new possibilities for creating imaginative 3D assets across various real-world scenarios.

3D Generation Text to 3D

Iterative Geometry Encoding Volume for Stereo Matching

1 code implementation CVPR 2023 Gangwei Xu, Xianqi Wang, Xiaohuan Ding, Xin Yang

The proposed IGEV-Stereo builds a combined geometry encoding volume that encodes geometry and context information as well as local matching details, and iteratively indexes it to update the disparity map.

Stereo Matching

Accurate and Efficient Stereo Matching via Attention Concatenation Volume

3 code implementations23 Sep 2022 Gangwei Xu, Yun Wang, Junda Cheng, Jinhui Tang, Xin Yang

In this paper, we present a novel cost volume construction method, named attention concatenation volume (ACV), which generates attention weights from correlation clues to suppress redundant information and enhance matching-related information in the concatenation volume.

Stereo Matching

CGI-Stereo: Accurate and Real-Time Stereo Matching via Context and Geometry Interaction

1 code implementation7 Jan 2023 Gangwei Xu, Huan Zhou, Xin Yang

In this paper, we propose CGI-Stereo, a novel neural network architecture that can concurrently achieve real-time performance, competitive accuracy, and strong generalization ability.

Stereo Matching

Understanding the Tricks of Deep Learning in Medical Image Segmentation: Challenges and Future Directions

1 code implementation21 Sep 2022 Dong Zhang, Yi Lin, Hao Chen, Zhuotao Tian, Xin Yang, Jinhui Tang, Kwang Ting Cheng

Over the past few years, the rapid development of deep learning technologies for computer vision has significantly improved the performance of medical image segmentation (MedISeg).

Data Augmentation Domain Adaptation +3

Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics

7 code implementations CVPR 2020 Yuezun Li, Xin Yang, Pu Sun, Honggang Qi, Siwei Lyu

AI-synthesized face-swapping videos, commonly known as DeepFakes, is an emerging problem threatening the trustworthiness of online information.

DeepFake Detection Face Swapping

Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset

2 code implementations CVPR 2019 Tianyu Wang, Xin Yang, Ke Xu, Shaozhe Chen, Qiang Zhang, Rynson Lau

Second, to better cover the stochastic distribution of real rain streaks, we propose a novel SPatial Attentive Network (SPANet) to remove rain streaks in a local-to-global manner.

Single Image Deraining Vocal Bursts Intensity Prediction

Bi-Real Net: Binarizing Deep Network Towards Real-Network Performance

1 code implementation4 Nov 2018 Zechun Liu, Wenhan Luo, Baoyuan Wu, Xin Yang, Wei Liu, Kwang-Ting Cheng

To address the training difficulty, we propose a training algorithm using a tighter approximation to the derivative of the sign function, a magnitude-aware gradient for weight updating, a better initialization method, and a two-step scheme for training a deep network.

Depth Estimation

SR-LIVO: LiDAR-Inertial-Visual Odometry and Mapping with Sweep Reconstruction

1 code implementation28 Dec 2023 Zikang Yuan, Jie Deng, Ruiye Ming, Fengtian Lang, Xin Yang

Existing LiDAR-inertial-visual odometry and mapping (LIV-SLAM) systems mainly utilize the LiDAR-inertial odometry (LIO) module for structure reconstruction and the visual-inertial odometry (VIO) module for color rendering.

Pose Estimation Visual Odometry

Boundary and Entropy-driven Adversarial Learning for Fundus Image Segmentation

1 code implementation26 Jun 2019 Shujun Wang, Lequan Yu, Kang Li, Xin Yang, Chi-Wing Fu, Pheng-Ann Heng

The cross-domain discrepancy (domain shift) hinders the generalization of deep neural networks to work on different domain datasets. In this work, we present an unsupervised domain adaptation framework, called Boundary and Entropy-driven Adversarial Learning (BEAL), to improve the OD and OC segmentation performance, especially on the ambiguous boundary regions.

Image Segmentation Segmentation +2

SAMUS: Adapting Segment Anything Model for Clinically-Friendly and Generalizable Ultrasound Image Segmentation

1 code implementation13 Sep 2023 Xian lin, Yangyang Xiang, Li Zhang, Xin Yang, Zengqiang Yan, Li Yu

Segment anything model (SAM), an eminent universal image segmentation model, has recently gathered considerable attention within the domain of medical image segmentation.

Image Segmentation Medical Image Segmentation +2

Generalizable Cross-modality Medical Image Segmentation via Style Augmentation and Dual Normalization

1 code implementation CVPR 2022 Ziqi Zhou, Lei Qi, Xin Yang, Dong Ni, Yinghuan Shi

For medical image segmentation, imagine if a model was only trained using MR images in source domain, how about its performance to directly segment CT images in target domain?

Domain Generalization Image Segmentation +3

Segment Anything Model for Medical Images?

1 code implementation28 Apr 2023 Yuhao Huang, Xin Yang, Lian Liu, Han Zhou, Ao Chang, Xinrui Zhou, Rusi Chen, Junxuan Yu, Jiongquan Chen, Chaoyu Chen, Sijing Liu, Haozhe Chi, Xindi Hu, Kejuan Yue, Lei LI, Vicente Grau, Deng-Ping Fan, Fajin Dong, Dong Ni

To fully validate SAM's performance on medical data, we collected and sorted 53 open-source datasets and built a large medical segmentation dataset with 18 modalities, 84 objects, 125 object-modality paired targets, 1050K 2D images, and 6033K masks.

Image Segmentation Medical Image Segmentation +3

Tripartite Information Mining and Integration for Image Matting

1 code implementation ICCV 2021 Yuhao Liu, Jiake Xie, Xiao Shi, Yu Qiao, Yujie Huang, Yong Tang, Xin Yang

Regarding the nature of image matting, most researches have focused on solutions for transition regions.

2k Image Matting

Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound

1 code implementation3 Jul 2019 Yi Wang, Haoran Dou, Xiao-Wei Hu, Lei Zhu, Xin Yang, Ming Xu, Jing Qin, Pheng-Ann Heng, Tianfu Wang, Dong Ni

Our attention module utilizes the attention mechanism to selectively leverage the multilevel features integrated from different layers to refine the features at each individual layer, suppressing the non-prostate noise at shallow layers of the CNN and increasing more prostate details into features at deep layers.

Image Segmentation Medical Image Segmentation +2

Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving

1 code implementation12 Mar 2024 Junda Cheng, Wei Yin, Kaixuan Wang, Xiaozhi Chen, Shijie Wang, Xin Yang

In this work, we propose a new robustness benchmark to evaluate the depth estimation system under various noisy pose settings.

Autonomous Driving Monocular Depth Estimation

Where Is My Mirror?

1 code implementation ICCV 2019 Xin Yang, Haiyang Mei, Ke Xu, Xiaopeng Wei, Bao-Cai Yin, Rynson W. H. Lau

To the best of our knowledge, this is the first work to address the mirror segmentation problem with a computational approach.

Segmentation

Exposing Deep Fakes Using Inconsistent Head Poses

1 code implementation1 Nov 2018 Xin Yang, Yuezun Li, Siwei Lyu

In this paper, we propose a new method to expose AI-generated fake face images or videos (commonly known as the Deep Fakes).

General Classification

Real-time Streaming Video Denoising with Bidirectional Buffers

1 code implementation14 Jul 2022 Chenyang Qi, Junming Chen, Xin Yang, Qifeng Chen

Recent multi-output inference works propagate the bidirectional temporal feature with a parallel or recurrent framework, which either suffers from performance drops on the temporal edges of clips or can not achieve online inference.

Denoising Video Denoising

Camouflaged Object Segmentation with Distraction Mining

1 code implementation CVPR 2021 Haiyang Mei, Ge-Peng Ji, Ziqi Wei, Xin Yang, Xiaopeng Wei, Deng-Ping Fan

In this paper, we strive to embrace challenges towards effective and efficient COS. To this end, we develop a bio-inspired framework, termed Positioning and Focus Network (PFNet), which mimics the process of predation in nature.

Camouflaged Object Segmentation Dichotomous Image Segmentation +3

Dual-Distribution Discrepancy for Anomaly Detection in Chest X-Rays

1 code implementation8 Jun 2022 Yu Cai, Hao Chen, Xin Yang, Yu Zhou, Kwang-Ting Cheng

Subsequently, inter-discrepancy between the two modules, and intra-discrepancy inside the module that is trained on only normal images are designed as anomaly scores to indicate anomalies.

One-Class Classification

Object Tracking by Jointly Exploiting Frame and Event Domain

2 code implementations ICCV 2021 Jiqing Zhang, Xin Yang, Yingkai Fu, Xiaopeng Wei, BaoCai Yin, Bo Dong

Our approach's effectiveness is enforced by a novel designed cross-domain attention schemes, which can effectively enhance features based on self- and cross-domain attention schemes; The adaptiveness is guarded by a specially designed weighting scheme, which can adaptively balance the contribution of the two domains.

Object Object Tracking

Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images

1 code implementation9 Oct 2022 Yu Cai, Hao Chen, Xin Yang, Yu Zhou, Kwang-Ting Cheng

Due to the high-cost annotations of abnormal images, most methods utilize only known normal images during training and identify samples deviating from the normal profile as anomalies in the testing phase.

Anomaly Detection Self-Supervised Learning

Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matching

1 code implementation1 Mar 2024 Xianqi Wang, Gangwei Xu, Hao Jia, Xin Yang

Stereo matching methods based on iterative optimization, like RAFT-Stereo and IGEV-Stereo, have evolved into a cornerstone in the field of stereo matching.

Stereo Matching

Instructive Feature Enhancement for Dichotomous Medical Image Segmentation

1 code implementation6 Jun 2023 Lian Liu, Han Zhou, Jiongquan Chen, Sijing Liu, Wenlong Shi, Dong Ni, Deng-Ping Fan, Xin Yang

Deep neural networks have been widely applied in dichotomous medical image segmentation (DMIS) of many anatomical structures in several modalities, achieving promising performance.

Image Segmentation Medical Image Segmentation +2

CPT: Efficient Deep Neural Network Training via Cyclic Precision

1 code implementation ICLR 2021 Yonggan Fu, Han Guo, Meng Li, Xin Yang, Yining Ding, Vikas Chandra, Yingyan Lin

In this paper, we attempt to explore low-precision training from a new perspective as inspired by recent findings in understanding DNN training: we conjecture that DNNs' precision might have a similar effect as the learning rate during DNN training, and advocate dynamic precision along the training trajectory for further boosting the time/energy efficiency of DNN training.

Language Modelling

Affinity Feature Strengthening for Accurate, Complete and Robust Vessel Segmentation

1 code implementation12 Nov 2022 Tianyi Shi, Xiaohuan Ding, Wei Zhou, Feng Pan, Zengqiang Yan, Xiang Bai, Xin Yang

Vessel segmentation is crucial in many medical image applications, such as detecting coronary stenoses, retinal vessel diseases and brain aneurysms.

A Two-Stage Attentive Network for Single Image Super-Resolution

1 code implementation21 Apr 2021 Jiqing Zhang, Chengjiang Long, Yuxin Wang, Haiyin Piao, Haiyang Mei, Xin Yang, BaoCai Yin

Recently, deep convolutional neural networks (CNNs) have been widely explored in single image super-resolution (SISR) and contribute remarkable progress.

Image Reconstruction Image Super-Resolution +1

Out-of-domain GAN inversion via Invertibility Decomposition for Photo-Realistic Human Face Manipulation

1 code implementation ICCV 2023 Xin Yang, Xiaogang Xu, Yingcong Chen

In this paper, we propose a novel framework that enhances the fidelity of human face inversion by designing a new module to decompose the input images to ID and OOD partitions with invertibility masks.

Attribute

MC-Stereo: Multi-peak Lookup and Cascade Search Range for Stereo Matching

1 code implementation4 Nov 2023 Miaojie Feng, Junda Cheng, Hao Jia, Longliang Liu, Gangwei Xu, Qingyong Hu, Xin Yang

This architecture mitigates the multi-peak distribution problem in matching through the multi-peak lookup strategy, and integrates the coarse-to-fine concept into the iterative framework via the cascade search range.

Representation Learning Stereo Matching

Co-trained convolutional neural networks for automated detection of prostate cancer in multi-parametric MRI

1 code implementation Elsevier 2017 Xin Yang, Chaoyue Liu, Zhiwei Wang, Jun Yang, Hung Le Min, Liang Wang, Kwang-Ting (Tim) Cheng

Each network is trained using images of a single modality in a weakly-supervised manner by providing a set of prostate images with image-level labels indicating only the presence of PCa without priors of lesions’ locations.

General Classification

A Discrepancy Aware Framework for Robust Anomaly Detection

1 code implementation11 Oct 2023 Yuxuan Cai, Dingkang Liang, Dongliang Luo, Xinwei He, Xin Yang, Xiang Bai

To alleviate this issue, we present a Discrepancy Aware Framework (DAF), which demonstrates robust performance consistently with simple and cheap strategies across different anomaly detection benchmarks.

Anomaly Detection Defect Detection +2

A Deep Attentive Convolutional Neural Network for Automatic Cortical Plate Segmentation in Fetal MRI

2 code implementations27 Apr 2020 Haoran Dou, Davood Karimi, Caitlin K. Rollins, Cynthia M. Ortinau, Lana Vasung, Clemente Velasco-Annis, Abdelhakim Ouaalam, Xin Yang, Dong Ni, Ali Gholipour

Automatic segmentation of the cortical plate, on the other hand, is challenged by the relatively low resolution of the reconstructed fetal brain MRI scans compared to the thin structure of the cortical plate, partial voluming, and the wide range of variations in the morphology of the cortical plate as the brain matures during gestation.

Segmentation

Agent with Warm Start and Active Termination for Plane Localization in 3D Ultrasound

1 code implementation10 Oct 2019 Haoran Dou, Xin Yang, Jikuan Qian, Wufeng Xue, Hao Qin, Xu Wang, Lequan Yu, Shujun Wang, Yi Xiong, Pheng-Ann Heng, Dong Ni

In this study, we propose a novel reinforcement learning (RL) framework to automatically localize fetal brain standard planes in 3D US.

Reinforcement Learning (RL)

Adaptive Densely Connected Super-Resolution Reconstruction

1 code implementation17 Dec 2019 Tangxin Xie, Xin Yang, Yu Jia, Chen Zhu, Xiaochuan Li

For a better performance in single image super-resolution(SISR), we present an image super-resolution algorithm based on adaptive dense connection (ADCSR).

Image Super-Resolution SSIM

AWSnet: An Auto-weighted Supervision Attention Network for Myocardial Scar and Edema Segmentation in Multi-sequence Cardiac Magnetic Resonance Images

1 code implementation14 Jan 2022 Kai-Ni Wang, Xin Yang, Juzheng Miao, Lei LI, Jing Yao, Ping Zhou, Wufeng Xue, Guang-Quan Zhou, Xiahai Zhuang, Dong Ni

Extensive experimental results on a publicly available dataset from Myocardial pathology segmentation combining multi-sequence CMR (MyoPS 2020) demonstrate our method can achieve promising performance compared with other state-of-the-art methods.

Segmentation

FedMix: Mixed Supervised Federated Learning for Medical Image Segmentation

1 code implementation4 May 2022 Jeffry Wicaksana, Zengqiang Yan, Dong Zhang, Xijie Huang, Huimin Wu, Xin Yang, Kwang-Ting Cheng

To relax this assumption, in this work, we propose a label-agnostic unified federated learning framework, named FedMix, for medical image segmentation based on mixed image labels.

Federated Learning Image Segmentation +4

GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration

1 code implementation26 Jun 2023 Haoran Dou, Ning Bi, Luyi Han, Yuhao Huang, Ritse Mann, Xin Yang, Dong Ni, Nishant Ravikumar, Alejandro F. Frangi, Yunzhi Huang

In this study, we construct a registration model based on the gradient surgery mechanism, named GSMorph, to achieve a hyperparameter-free balance on multiple losses.

In the Blink of an Eye: Event-based Emotion Recognition

1 code implementation6 Oct 2023 Haiwei Zhang, Jiqing Zhang, Bo Dong, Pieter Peers, Wenwei Wu, Xiaopeng Wei, Felix Heide, Xin Yang

To the best of our knowledge, our method is the first eye-based emotion recognition method that leverages event-based cameras and spiking neural network.

Emotion Recognition

FSOINet: Feature-Space Optimization-Inspired Network for Image Compressive Sensing

1 code implementation12 Apr 2022 Wenjun Chen, Chunling Yang, Xin Yang

In recent years, deep learning-based image compressive sensing (ICS) methods have achieved brilliant success.

Compressive Sensing

FedIIC: Towards Robust Federated Learning for Class-Imbalanced Medical Image Classification

1 code implementation28 Jun 2022 Nannan Wu, Li Yu, Xin Yang, Kwang-Ting Cheng, Zengqiang Yan

In this paper, we present a privacy-preserving FL method named FedIIC to combat class imbalance from two perspectives: feature learning and classifier learning.

Contrastive Learning Federated Learning +3

Bi-directional Object-context Prioritization Learning for Saliency Ranking

1 code implementation CVPR 2022 Xin Tian, Ke Xu, Xin Yang, Lin Du, BaoCai Yin, Rynson W. H. Lau

We observe that spatial attention works concurrently with object-based attention in the human visual recognition system.

Object Saliency Ranking

Bidirectional Semi-supervised Dual-branch CNN for Robust 3D Reconstruction of Stereo Endoscopic Images via Adaptive Cross and Parallel Supervisions

1 code implementation15 Oct 2022 Hongkuan Shi, Zhiwei Wang, Ying Zhou, Dun Li, Xin Yang, Qiang Li

The learned knowledge flows across branches along two directions: a cross direction (disparity guides distribution in ACS) and a parallel direction (disparity guides disparity in APS).

3D Reconstruction Disparity Estimation

DoFE: Domain-oriented Feature Embedding for Generalizable Fundus Image Segmentation on Unseen Datasets

1 code implementation13 Oct 2020 Shujun Wang, Lequan Yu, Kang Li, Xin Yang, Chi-Wing Fu, Pheng-Ann Heng

Our DoFE framework dynamically enriches the image features with additional domain prior knowledge learned from multi-source domains to make the semantic features more discriminative.

Domain Generalization Image Segmentation +2

Deep Polarization Reconstruction With PDAVIS Events

1 code implementation CVPR 2023 Haiyang Mei, Zuowen Wang, Xin Yang, Xiaopeng Wei, Tobi Delbruck

The polarization event camera PDAVIS is a novel bio-inspired neuromorphic vision sensor that reports both conventional polarization frames and asynchronous, continuously per-pixel polarization brightness changes (polarization events) with fast temporal resolution and large dynamic range.

Total Least Squares Regression in Input Sparsity Time

1 code implementation NeurIPS 2019 Huaian Diao, Zhao Song, David P. Woodruff, Xin Yang

In the total least squares problem, one is given an $m \times n$ matrix $A$, and an $m \times d$ matrix $B$, and one seeks to "correct" both $A$ and $B$, obtaining matrices $\hat{A}$ and $\hat{B}$, so that there exists an $X$ satisfying the equation $\hat{A}X = \hat{B}$.

regression

Dual-view Correlation Hybrid Attention Network for Robust Holistic Mammogram Classification

1 code implementation19 Jun 2023 Zhiwei Wang, Junlin Xian, Kangyi Liu, Xin Li, Qiang Li, Xin Yang

Mammogram image is important for breast cancer screening, and typically obtained in a dual-view form, i. e., cranio-caudal (CC) and mediolateral oblique (MLO), to provide complementary information.

Clinical Knowledge

Deriving Autism Spectrum Disorder Functional Networks from RS-FMRI Data using Group ICA and Dictionary Learning

1 code implementation7 Jun 2021 Xin Yang, Ning Zhang, Donglin Wang

Fourth, we generate three corresponding masks based on the 20 selected ROIs from group ICA, the 20 ROIs selected from dictionary learning, and the 40 combined ROIs selected from both.

Dictionary Learning

Exploiting Polarized Material Cues for Robust Car Detection

1 code implementation5 Jan 2024 Wen Dong, Haiyang Mei, Ziqi Wei, Ao Jin, Sen Qiu, Qiang Zhang, Xin Yang

Car detection is an important task that serves as a crucial prerequisite for many automated driving functions.

Inflated 3D Convolution-Transformer for Weakly-supervised Carotid Stenosis Grading with Ultrasound Videos

1 code implementation5 Jun 2023 Xinrui Zhou, Yuhao Huang, Wufeng Xue, Xin Yang, Yuxin Zou, Qilong Ying, Yuanji Zhang, Jia Liu, Jie Ren, Dong Ni

First, to avoid the requirement of laborious and unreliable annotation, we propose a novel and effective video classification network for weakly-supervised CSG.

Video Classification

Deep graph matching meets mixed-integer linear programming: Relax at your own risk ?

2 code implementations1 Aug 2021 Zhoubo Xu, Puqing Chen, Romain Raveaux, Xin Yang, Huadong Liu

Graph matching is an important problem that has received widespread attention, especially in the field of computer vision.

Graph Matching

Active Object Reconstruction Using a Guided View Planner

no code implementations8 May 2018 Xin Yang, Yuanbo Wang, Yaru Wang, Bao-Cai Yin, Qiang Zhang, Xiaopeng Wei, Hongbo Fu

Inspired by the recent advance of image-based object reconstruction using deep learning, we present an active reconstruction model using a guided view planner.

Object Object Reconstruction

Neural Compatibility Modeling with Attentive Knowledge Distillation

no code implementations17 Apr 2018 Xuemeng Song, Fuli Feng, Xianjing Han, Xin Yang, Wei Liu, Liqiang Nie

Nevertheless, existing studies overlook the rich valuable knowledge (rules) accumulated in fashion domain, especially the rules regarding clothing matching.

Image Classification Knowledge Distillation +2

Time-Space Tradeoffs for Learning from Small Test Spaces: Learning Low Degree Polynomial Functions

no code implementations8 Aug 2017 Paul Beame, Shayan Oveis Gharan, Xin Yang

We develop an extension of recently developed methods for obtaining time-space tradeoff lower bounds for problems of learning from random test samples to handle the situation where the space of tests is signficantly smaller than the space of inputs, a class of learning problems that is not handled by prior work.

Fine-grained Recurrent Neural Networks for Automatic Prostate Segmentation in Ultrasound Images

no code implementations6 Dec 2016 Xin Yang, Lequan Yu, Lingyun Wu, Yi Wang, Dong Ni, Jing Qin, Pheng-Ann Heng

Additionally, our approach is general and can be extended to other medical image segmentation tasks, where boundary incompleteness is one of the main challenges.

Image Segmentation Medical Image Segmentation +1

Concept based Attention

no code implementations11 May 2016 Jie You, Xin Yang, Matthias Hub

Attention endows animals an ability to concentrate on the most relevant information among a deluge of distractors at any given time, either through volitionally 'top-down' biasing, or driven by automatically 'bottom-up' saliency of stimuli, in favour of advantageous competition in neural modulations for information processing.

Tool Breakage Detection using Deep Learning

no code implementations16 Aug 2018 Guang Li, Xin Yang, DuanBing Chen, Anxing Song, Yuke Fang, Junlin Zhou

In this work, we use the spindle current approach to detect the breakage of machine tools, which has the high performance of real-time monitoring, low cost, and easy to install.

Management

Deep Hierarchical Machine: a Flexible Divide-and-Conquer Architecture

no code implementations3 Dec 2018 Shichao Li, Xin Yang, Tim Cheng

We propose Deep Hierarchical Machine (DHM), a model inspired from the divide-and-conquer strategy while emphasizing representation learning ability and flexibility.

Face Alignment General Classification +3

Semi-supervised mp-MRI Data Synthesis with StitchLayer and Auxiliary Distance Maximization

no code implementations17 Dec 2018 Zhiwei Wang, Yi Lin, Kwang-Ting Cheng, Xin Yang

Experimental results show that our method can effectively synthesize a large variety of mpMRI images which contain meaningful CS PCa lesions, display a good visual quality and have the correct paired relationship.

Synthesizing Multi-Parameter Magnetic Resonance Imaging (Mp-Mri) Data

Active Matting

no code implementations NeurIPS 2018 Xin Yang, Ke Xu, Shaozhe Chen, Shengfeng He, Baocai Yin Yin, Rynson Lau

Our aim is to discover the most informative sequence of regions for user input in order to produce a good alpha matte with minimum labeling efforts.

Image Matting

Patch-based Output Space Adversarial Learning for Joint Optic Disc and Cup Segmentation

no code implementations20 Feb 2019 Shujun Wang, Lequan Yu, Xin Yang, Chi-Wing Fu, Pheng-Ann Heng

In this paper, we present a novel patchbased Output Space Adversarial Learning framework (pOSAL) to jointly and robustly segment the OD and OC from different fundus image datasets.

Segmentation Unsupervised Domain Adaptation

Deep Reinforcement Learning of Volume-guided Progressive View Inpainting for 3D Point Scene Completion from a Single Depth Image

no code implementations CVPR 2019 Xiaoguang Han, Zhaoxuan Zhang, Dong Du, Mingdai Yang, Jingming Yu, Pan Pan, Xin Yang, Ligang Liu, Zixiang Xiong, Shuguang Cui

Given a single depth image, our method first goes through the 3D volume branch to obtain a volumetric scene reconstruction as a guide to the next view inpainting step, which attempts to make up the missing information; the third step involves projecting the volume under the same view of the input, concatenating them to complete the current view depth, and integrating all depth into the point cloud.

Exposing GAN-synthesized Faces Using Landmark Locations

no code implementations30 Mar 2019 Xin Yang, Yuezun Li, Honggang Qi, Siwei Lyu

Generative adversary networks (GANs) have recently led to highly realistic image synthesis results.

General Classification Image Generation

Quadratic Suffices for Over-parametrization via Matrix Chernoff Bound

no code implementations9 Jun 2019 Zhao Song, Xin Yang

We improve the over-parametrization size over two beautiful results [Li and Liang' 2018] and [Du, Zhai, Poczos and Singh' 2019] in deep learning theory.

Learning Theory

Uncertainty-Guided Domain Alignment for Layer Segmentation in OCT Images

no code implementations22 Aug 2019 Jiexiang Wang, Cheng Bian, Meng Li, Xin Yang, Kai Ma, Wenao Ma, Jin Yuan, Xinghao Ding, Yefeng Zheng

Automatic and accurate segmentation for retinal and choroidal layers of Optical Coherence Tomography (OCT) is crucial for detection of various ocular diseases.

Segmentation

DRFN: Deep Recurrent Fusion Network for Single-Image Super-Resolution with Large Factors

no code implementations23 Aug 2019 Xin Yang, Haiyang Mei, Jiqing Zhang, Ke Xu, Bao-Cai Yin, Qiang Zhang, Xiaopeng Wei

Recently, single-image super-resolution has made great progress owing to the development of deep convolutional neural networks (CNNs).

Image Super-Resolution

Joint Segmentation and Landmark Localization of Fetal Femur in Ultrasound Volumes

no code implementations31 Aug 2019 Xu Wang, Xin Yang, Haoran Dou, Shengli Li, Pheng-Ann Heng, Dong Ni

In this paper, we propose an effective framework for simultaneous segmentation and landmark localization in prenatal ultrasound volumes.

Segmentation

One-Shot Imitation Filming of Human Motion Videos

no code implementations23 Dec 2019 Chong Huang, Yuanjie Dang, Peng Chen, Xin Yang, Kwang-Ting, Cheng

Imitation learning has been applied to mimic the operation of a human cameraman in several autonomous cinematography systems.

Imitation Learning Style Transfer

Sketching Transformed Matrices with Applications to Natural Language Processing

no code implementations23 Feb 2020 Yingyu Liang, Zhao Song, Mengdi Wang, Lin F. Yang, Xin Yang

We show that our approach obtains small error and is efficient in both space and time.

TENet: Triple Excitation Network for Video Salient Object Detection

no code implementations ECCV 2020 Sucheng Ren, Chu Han, Xin Yang, Guoqiang Han, Shengfeng He

In this paper, we propose a simple yet effective approach, named Triple Excitation Network, to reinforce the training of video salient object detection (VSOD) from three aspects, spatial, temporal, and online excitations.

Object object-detection +2

Computer-aided Tumor Diagnosis in Automated Breast Ultrasound using 3D Detection Network

no code implementations31 Jul 2020 Junxiong Yu, Chaoyu Chen, Xin Yang, Yi Wang, Dan Yan, Jianxing Zhang, Dong Ni

The efficacy of our network is verified from a collected dataset of 418 patients with 145 benign tumors and 273 malignant tumors.

Breast Cancer Detection Classification +1

Designing Neural Networks for Real-Time Systems

no code implementations26 Aug 2020 Hammond Pearce, Xin Yang, Partha S. Roop, Marc Katzef, Tórur Biskopstø Strøm

This issue stems largely from the implementation strategies used within common neural network frameworks -- their underlying source code is often simply unsuitable for formal techniques such as static timing analysis.

C++ code

Style-invariant Cardiac Image Segmentation with Test-time Augmentation

no code implementations24 Sep 2020 Xiaoqiong Huang, Zejian Chen, Xin Yang, Zhendong Liu, Yuxin Zou, Mingyuan Luo, Wufeng Xue, Dong Ni

Based on the zero-shot style transfer to remove appearance shift and test-time augmentation to explore diverse underlying anatomy, our proposed method is effective in combating the appearance shift.

Anatomy Cardiac Segmentation +5

Weakly-supervised Salient Instance Detection

no code implementations29 Sep 2020 Xin Tian, Ke Xu, Xin Yang, Bao-Cai Yin, Rynson W. H. Lau

Inspired by this insight, we propose to use class and subitizing labels as weak supervision for the SID problem.

Boundary Detection Object Localization +1

Multi-scale Information Assembly for Image Matting

no code implementations7 Jan 2021 Yu Qiao, Yuhao Liu, Qiang Zhu, Xin Yang, Yuxin Wang, Qiang Zhang, Xiaopeng Wei

Image matting is a long-standing problem in computer graphics and vision, mostly identified as the accurate estimation of the foreground in input images.

Image Matting

Automatic Comic Generation with Stylistic Multi-page Layouts and Emotion-driven Text Balloon Generation

no code implementations26 Jan 2021 Xin Yang, Zongliang Ma, Letian Yu, Ying Cao, BaoCai Yin, Xiaopeng Wei, Qiang Zhang, Rynson W. H. Lau

Finally, as opposed to using the same type of balloon as in previous works, we propose an emotion-aware balloon generation method to create different types of word balloons by analyzing the emotion of subtitles and audios.

Smart Scribbles for Image Mating

no code implementations31 Mar 2021 Xin Yang, Yu Qiao, Shaozhe Chen, Shengfeng He, BaoCai Yin, Qiang Zhang, Xiaopeng Wei, Rynson W. H. Lau

Image matting is an ill-posed problem that usually requires additional user input, such as trimaps or scribbles.

Image Matting

FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis

no code implementations11 May 2021 Baihe Huang, Xiaoxiao Li, Zhao Song, Xin Yang

Nevertheless, training analysis of neural networks in FL is non-trivial for two reasons: first, the objective loss function we are optimizing is non-smooth and non-convex, and second, we are even not updating in the gradient direction.

Federated Learning

Vertical Federated Learning without Revealing Intersection Membership

no code implementations10 Jun 2021 Jiankai Sun, Xin Yang, Yuanshun Yao, Aonan Zhang, Weihao Gao, Junyuan Xie, Chong Wang

In this paper, we propose a vFL framework based on Private Set Union (PSU) that allows each party to keep sensitive membership information to itself.

Vertical Federated Learning

Joint Landmark and Structure Learning for Automatic Evaluation of Developmental Dysplasia of the Hip

no code implementations10 Jun 2021 Xindi Hu, LiMin Wang, Xin Yang, Xu Zhou, Wufeng Xue, Yan Cao, Shengfeng Liu, Yuhao Huang, Shuangping Guo, Ning Shang, Dong Ni, Ning Gu

In this study, we propose a multi-task framework to learn the relationships among landmarks and structures jointly and automatically evaluate DDH.

LENAS: Learning-based Neural Architecture Search and Ensemble for 3D Radiotherapy Dose Prediction

no code implementations12 Jun 2021 Yi Lin, Yanfei Liu, Hao Chen, Xin Yang, Kai Ma, Yefeng Zheng, Kwang-Ting Cheng

To the best of our knowledge, this is the first attempt to investigate NAS and knowledge distillation in ensemble learning, especially in the field of medical image analysis.

Ensemble Learning Knowledge Distillation +1

Prior-Induced Information Alignment for Image Matting

no code implementations28 Jun 2021 Yuhao Liu, Jiake Xie, Yu Qiao, Yong Tang and, Xin Yang

Image matting is an ill-posed problem that aims to estimate the opacity of foreground pixels in an image.

Image Matting

Depth-Aware Mirror Segmentation

no code implementations CVPR 2021 Haiyang Mei, Bo Dong, Wen Dong, Pieter Peers, Xin Yang, Qiang Zhang, Xiaopeng Wei

To exploit depth information in mirror segmentation, we first construct a large-scale RGB-D mirror segmentation dataset, which we subsequently employ to train a novel depth-aware mirror segmentation framework.

Segmentation

Feature-Level Collaboration: Joint Unsupervised Learning of Optical Flow, Stereo Depth and Camera Motion

no code implementations CVPR 2021 Cheng Chi, Qingjie Wang, Tianyu Hao, Peng Guo, Xin Yang

In this paper, we show that effective feature-level collaboration of the networks for the three respective tasks could achieve much greater performance improvement for all three tasks than only loss-level joint optimization.

Depth And Camera Motion Motion Estimation +4

Multi-domain Collaborative Feature Representation for Robust Visual Object Tracking

no code implementations10 Aug 2021 Jiqing Zhang, Kai Zhao, Bo Dong, Yingkai Fu, Yuxin Wang, Xin Yang, BaoCai Yin

Jointly exploiting multiple different yet complementary domain information has been proven to be an effective way to perform robust object tracking.

Visual Object Tracking

WRICNet:A Weighted Rich-scale Inception Coder Network for Multi-Resolution Remote Sensing Image Change Detection

no code implementations18 Aug 2021 Yu Jiang, Lei Hu, Yongmei Zhang, Xin Yang

With the purpose of improving change detection effectiveness of the model in the multi-resolution data set, a weighted rich-scale inception coder network (WRICNet) is proposed in this article, which can make a great fusion of shallow multi-scale features, and deep multi-scale features.

Change Detection

Self-supervised Representation Learning for Trip Recommendation

no code implementations2 Sep 2021 Qiang Gao, Wei Wang, Kunpeng Zhang, Xin Yang, Congcong Miao

Although recent deep recursive models (e. g., RNN) are capable of alleviating these concerns, existing solutions hardly recognize the practical reality, such as the diversity of tourist demands, uncertainties in the trip generation, and the complex visiting preference.

Contrastive Learning point of interests +1

Monocular Depth Estimation with Sharp Boundary

no code implementations12 Oct 2021 Xin Yang, Qingling Chang, Xinlin Liu, Yan Cui

In order to mitigate the boundary blur problem, we focus on the above two impact factors.

Monocular Depth Estimation Scene Understanding

Automated Pulmonary Embolism Detection from CTPA Images Using an End-to-End Convolutional Neural Network

no code implementations10 Nov 2021 Yi Lin, Jianchao Su, Xiang Wang, Xiang Li, Jingen Liu, Kwang-Ting Cheng, Xin Yang

We have evaluated our approach using the 20 CTPA test dataset from the PE challenge, achieving a sensitivity of 78. 9%, 80. 7% and 80. 7% at 2 false positives per volume at 0mm, 2mm and 5mm localization error, which is superior to the state-of-the-art methods.

Pulmonary Embolism Detection

Learning to Detect Instance-level Salient Objects Using Complementary Image Labels

no code implementations19 Nov 2021 Xin Tian, Ke Xu, Xin Yang, BaoCai Yin, Rynson W. H. Lau

However, it is non-trivial to use only class labels to learn instance-aware saliency information, as salient instances with high semantic affinities may not be easily separated by the labels.

Boundary Detection Object Localization +1

CPRAL: Collaborative Panoptic-Regional Active Learning for Semantic Segmentation

no code implementations11 Dec 2021 Yu Qiao, Jincheng Zhu, Chengjiang Long, Zeyao Zhang, Yuxin Wang, Zhenjun Du, Xin Yang

Acquiring the most representative examples via active learning (AL) can benefit many data-dependent computer vision tasks by minimizing efforts of image-level or pixel-wise annotations.

Active Learning Semantic Segmentation

SECP-Net: SE-Connection Pyramid Network of Organ At Risk Segmentation for Nasopharyngeal Carcinoma

no code implementations28 Dec 2021 Zexi Huang, Lihua Guo, Xin Yang, Sijuan Huang

SECP-Net extracts global and multi-size information flow with se connection (SEC) modules and a pyramid structure of network for improving the segmentation performance, especially that of small organs.

Computed Tomography (CT) Image Segmentation +3

Label Leakage and Protection from Forward Embedding in Vertical Federated Learning

no code implementations2 Mar 2022 Jiankai Sun, Xin Yang, Yuanshun Yao, Chong Wang

As the raw labels often contain highly sensitive information, some recent work has been proposed to prevent the label leakage from the backpropagated gradients effectively in vFL.

Vertical Federated Learning

Differentially Private Label Protection in Split Learning

no code implementations4 Mar 2022 Xin Yang, Jiankai Sun, Yuanshun Yao, Junyuan Xie, Chong Wang

Split learning is a distributed training framework that allows multiple parties to jointly train a machine learning model over vertically partitioned data (partitioned by attributes).

HASA: Hybrid Architecture Search with Aggregation Strategy for Echinococcosis Classification and Ovary Segmentation in Ultrasound Images

no code implementations14 Apr 2022 Jikuan Qian, Rui Li, Xin Yang, Yuhao Huang, Mingyuan Luo, Zehui Lin, Wenhui Hong, Ruobing Huang, Haining Fan, Dong Ni, Jun Cheng

The hybrid framework consists of a pre-trained backbone and several searched cells (i. e., network building blocks), which takes advantage of the strengths of both NAS and the expert knowledge from existing convolutional neural networks.

Image Classification Neural Architecture Search +1

Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesis

no code implementations14 Apr 2022 Jiamin Liang, Xin Yang, Yuhao Huang, Haoming Li, Shuangchi He, Xindi Hu, Zejian Chen, Wufeng Xue, Jun Cheng, Dong Ni

Our main contributions include: 1) we present the first work that can synthesize realistic B-mode US images with high-resolution and customized texture editing features; 2) to enhance structural details of generated images, we propose to introduce auxiliary sketch guidance into a conditional GAN.

Generative Adversarial Network Image Generation

Differentially Private AUC Computation in Vertical Federated Learning

no code implementations24 May 2022 Jiankai Sun, Xin Yang, Yuanshun Yao, Junyuan Xie, Di wu, Chong Wang

In this work, we propose two evaluation algorithms that can more accurately compute the widely used AUC (area under curve) metric when using label DP in vFL.

Vertical Federated Learning

Spiking Transformers for Event-Based Single Object Tracking

no code implementations CVPR 2022 Jiqing Zhang, Bo Dong, Haiwei Zhang, Jianchuan Ding, Felix Heide, BaoCai Yin, Xin Yang

In particular, the proposed architecture features a transformer module to provide global spatial information and a spiking neural network (SNN) module for extracting temporal cues.

Object Object Tracking

Glass Segmentation Using Intensity and Spectral Polarization Cues

no code implementations CVPR 2022 Haiyang Mei, Bo Dong, Wen Dong, Jiaxi Yang, Seung-Hwan Baek, Felix Heide, Pieter Peers, Xiaopeng Wei, Xin Yang

Transparent and semi-transparent materials pose significant challenges for existing scene understanding and segmentation algorithms due to their lack of RGB texture which impedes the extraction of meaningful features.

Scene Understanding Segmentation +1

Accurate Scoliosis Vertebral Landmark Localization on X-ray Images via Shape-constrained Multi-stage Cascaded CNNs

no code implementations5 Jun 2022 Zhiwei Wang, Jinxin Lv, Yunqiao Yang, Yuanhuai Liang, Yi Lin, Qiang Li, Xin Li, Xin Yang

Vertebral landmark localization is a crucial step for variant spine-related clinical applications, which requires detecting the corner points of 17 vertebrae.

Differentially Private Multi-Party Data Release for Linear Regression

no code implementations16 Jun 2022 Ruihan Wu, Xin Yang, Yuanshun Yao, Jiankai Sun, Tianyi Liu, Kilian Q. Weinberger, Chong Wang

Differentially Private (DP) data release is a promising technique to disseminate data without compromising the privacy of data subjects.

regression

Weakly-supervised High-fidelity Ultrasound Video Synthesis with Feature Decoupling

no code implementations1 Jul 2022 Jiamin Liang, Xin Yang, Yuhao Huang, Kai Liu, Xinrui Zhou, Xindi Hu, Zehui Lin, Huanjia Luo, Yuanji Zhang, Yi Xiong, Dong Ni

First, leveraging the advantages of self- and fully-supervised learning, our proposed system is trained in weakly-supervised manner for keypoint detection.

Keypoint Detection Vocal Bursts Intensity Prediction

Fine-grained Correlation Loss for Regression

no code implementations1 Jul 2022 Chaoyu Chen, Xin Yang, Ruobing Huang, Xindi Hu, Yankai Huang, Xiduo Lu, Xinrui Zhou, Mingyuan Luo, Yinyu Ye, Xue Shuang, Juzheng Miao, Yi Xiong, Dong Ni

In this work, we propose to revisit the classic regression tasks with novel investigations on directly optimizing the fine-grained correlation losses.

Attribute Image Quality Assessment +3

Multi-Attribute Attention Network for Interpretable Diagnosis of Thyroid Nodules in Ultrasound Images

no code implementations9 Jul 2022 Van T. Manh, Jianqiao Zhou, Xiaohong Jia, Zehui Lin, Wenwen Xu, Zihan Mei, Yijie Dong, Xin Yang, Ruobing Huang, Dong Ni

To overcome this, we propose a novel deep learning framework called multi-attribute attention network (MAA-Net) that is designed to mimic the clinical diagnosis process.

Attribute

Progressive Glass Segmentation

no code implementations6 Sep 2022 Letian Yu, Haiyang Mei, Wen Dong, Ziqi Wei, Li Zhu, Yuxin Wang, Xin Yang

First, we attempt to bridge the characteristic gap between different levels of features by developing a Discriminability Enhancement (DE) module which enables level-specific features to be a more discriminative representation, alleviating the features incompatibility for fusion.

Segmentation

Blinder: End-to-end Privacy Protection in Sensing Systems via Personalized Federated Learning

1 code implementation24 Sep 2022 Xin Yang, Omid Ardakanian

This paper proposes a sensor data anonymization model that is trained on decentralized data and strikes a desirable trade-off between data utility and privacy, even in heterogeneous settings where the sensor data have different underlying distributions.

Meta-Learning Personalized Federated Learning

Point Cloud Scene Completion with Joint Color and Semantic Estimation from Single RGB-D Image

no code implementations12 Oct 2022 Zhaoxuan Zhang, Xiaoguang Han, Bo Dong, Tong Li, BaoCai Yin, Xin Yang

Given a single RGB-D image, our method first predicts its semantic segmentation map and goes through the 3D volume branch to obtain a volumetric scene reconstruction as a guide to the next view inpainting step, which attempts to make up the missing information; the third step involves projecting the volume under the same view of the input, concatenating them to complete the current view RGB-D and segmentation map, and integrating all RGB-D and segmentation maps into the point cloud.

Image Inpainting Segmentation +1

Wider and Higher: Intensive Integration and Global Foreground Perception for Image Matting

no code implementations13 Oct 2022 Yu Qiao, Ziqi Wei, Yuhao Liu, Yuxin Wang, Dongsheng Zhou, Qiang Zhang, Xin Yang

This paper reviews recent deep-learning-based matting research and conceives our wider and higher motivation for image matting.

Image Matting

Hierarchical and Progressive Image Matting

no code implementations13 Oct 2022 Yu Qiao, Yuhao Liu, Ziqi Wei, Yuxin Wang, Qiang Cai, Guofeng Zhang, Xin Yang

In this paper, we propose an end-to-end Hierarchical and Progressive Attention Matting Network (HAttMatting++), which can better predict the opacity of the foreground from single RGB images without additional input.

Image Matting SSIM

Label Inference Attack against Split Learning under Regression Setting

1 code implementation18 Jan 2023 Shangyu Xie, Xin Yang, Yuanshun Yao, Tianyi Liu, Taiqing Wang, Jiankai Sun

In this work, we step further to study the leakage in the scenario of the regression model, where the private labels are continuous numbers (instead of discrete labels in classification).

Inference Attack regression +1

Netflix and Forget: Efficient and Exact Machine Unlearning from Bi-linear Recommendations

no code implementations13 Feb 2023 Mimee Xu, Jiankai Sun, Xin Yang, Kevin Yao, Chong Wang

Without incurring the cost of re-training, and without degrading the model unnecessarily, we develop Unlearn-ALS by making a few key modifications to the fine-tuning procedure under Alternating Least Squares optimisation, thus applicable to any bi-linear models regardless of the training procedure.

Machine Unlearning Matrix Completion

Exploiting Implicit Rigidity Constraints via Weight-Sharing Aggregation for Scene Flow Estimation from Point Clouds

no code implementations4 Mar 2023 Yun Wang, Cheng Chi, Xin Yang

Scene flow estimation, which predicts the 3D motion of scene points from point clouds, is a core task in autonomous driving and many other 3D vision applications.

Autonomous Driving Pose Estimation +2

Robust Multimodal Fusion for Human Activity Recognition

no code implementations8 Mar 2023 Sanju Xaviar, Xin Yang, Omid Ardakanian

Compared to 2 related robust fusion architectures, Centaur is more robust, achieving 11. 59-17. 52% higher accuracy in HAR, especially in the presence of consecutive missing data in multiple sensor channels.

Denoising Human Activity Recognition +2

Hierarchical Agent-based Reinforcement Learning Framework for Automated Quality Assessment of Fetal Ultrasound Video

no code implementations14 Apr 2023 Sijing Liu, Qilong Ying, Shuangchi He, Xin Yang, Dong Ni, Ruobing Huang

Ultrasound is the primary modality to examine fetal growth during pregnancy, while the image quality could be affected by various factors.

Differentially Private Attention Computation

no code implementations8 May 2023 Yeqi Gao, Zhao Song, Xin Yang

Inspired by [Vyas, Kakade and Barak 2023], in this work, we provide a provable result for showing how to differentially private approximate the attention matrix.

An image segmentation algorithm based on multi-scale feature pyramid network

no code implementations18 May 2023 Yu Xiao, Xin Yang, Sijuan Huang, Lihua Guo

Medical image segmentation is particularly critical as a prerequisite for relevant quantitative analysis in the treatment of clinical diseases.

Image Segmentation Medical Image Segmentation +3

Frame-Event Alignment and Fusion Network for High Frame Rate Tracking

no code implementations CVPR 2023 Jiqing Zhang, Yuanchen Wang, Wenxi Liu, Meng Li, Jinpeng Bai, BaoCai Yin, Xin Yang

The alignment module is responsible for cross-style and cross-frame-rate alignment between frame and event modalities under the guidance of the moving cues furnished by events.

Object Tracking

Fourier Test-time Adaptation with Multi-level Consistency for Robust Classification

no code implementations5 Jun 2023 Yuhao Huang, Xin Yang, Xiaoqiong Huang, Xinrui Zhou, Haozhe Chi, Haoran Dou, Xindi Hu, Jian Wang, Xuedong Deng, Dong Ni

Second, we introduce a regularization technique that utilizes style interpolation consistency in the frequency space to encourage self-consistency in the logit space of the model output.

Robust classification Test-time Adaptation

Multi-IMU with Online Self-Consistency for Freehand 3D Ultrasound Reconstruction

no code implementations28 Jun 2023 Mingyuan Luo, Xin Yang, Zhongnuo Yan, Junyu Li, Yuanji Zhang, Jiongquan Chen, Xindi Hu, Jikuan Qian, Jun Cheng, Dong Ni

Ultrasound (US) imaging is a popular tool in clinical diagnosis, offering safety, repeatability, and real-time capabilities.

Fast Quantum Algorithm for Attention Computation

no code implementations16 Jul 2023 Yeqi Gao, Zhao Song, Xin Yang, Ruizhe Zhang

It is well-known that quantum machine has certain computational advantages compared to the classical machine.

Language Modelling Machine Translation +5

OnUVS: Online Feature Decoupling Framework for High-Fidelity Ultrasound Video Synthesis

no code implementations16 Aug 2023 Han Zhou, Dong Ni, Ao Chang, Xinrui Zhou, Rusi Chen, Yanlin Chen, Lian Liu, Jiamin Liang, Yuhao Huang, Tong Han, Zhe Liu, Deng-Ping Fan, Xin Yang

Second, to better preserve the integrity and textural information of US images, we implemented a dual-decoder that decouples the content and textural features in the generator.

PE-MED: Prompt Enhancement for Interactive Medical Image Segmentation

no code implementations26 Aug 2023 Ao Chang, Xing Tao, Xin Yang, Yuhao Huang, Xinrui Zhou, Jiajun Zeng, Ruobing Huang, Dong Ni

It can prevent the highly unfavorable scenarios, such as encountering a blank mask as the initial input after the first interaction.

Image Segmentation Medical Image Segmentation +3

Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks

no code implementations27 Aug 2023 Xin Yang, Yi Lin, Zhiwei Wang, Xin Li, Kwang-Ting Cheng

A method for measuring the synthesis complexity is proposed to automatically determine the synthesis order in our sequential GAN.

Generative Adversarial Network Image Generation

FFPN: Fourier Feature Pyramid Network for Ultrasound Image Segmentation

no code implementations26 Aug 2023 Chaoyu Chen, Xin Yang, Rusi Chen, Junxuan Yu, Liwei Du, Jian Wang, Xindi Hu, Yan Cao, Yingying Liu, Dong Ni

In this paper, we introduce a novel Fourier-anchor-based DTS framework called Fourier Feature Pyramid Network (FFPN) to address the aforementioned issues.

Image Segmentation Semantic Segmentation

Single Depth-image 3D Reflection Symmetry and Shape Prediction

no code implementations ICCV 2023 Zhaoxuan Zhang, Bo Dong, Tong Li, Felix Heide, Pieter Peers, BaoCai Yin, Xin Yang

In this paper, we present Iterative Symmetry Completion Network (ISCNet), a single depth-image shape completion method that exploits reflective symmetry cues to obtain more detailed shapes.

IHNet: Iterative Hierarchical Network Guided by High-Resolution Estimated Information for Scene Flow Estimation

no code implementations ICCV 2023 Yun Wang, Cheng Chi, Min Lin, Xin Yang

This approach circulates high-resolution estimated information (scene flow and feature) from the preceding iteration back to the low-resolution layer of the current iteration.

Autonomous Driving Computational Efficiency +1

Multi-view Spectral Polarization Propagation for Video Glass Segmentation

no code implementations ICCV 2023 Yu Qiao, Bo Dong, Ao Jin, Yu Fu, Seung-Hwan Baek, Felix Heide, Pieter Peers, Xiaopeng Wei, Xin Yang

In this paper, we present the first polarization-guided video glass segmentation propagation solution (PGVS-Net) that can robustly and coherently propagate glass segmentation in RGB-P video sequences.

Image Segmentation Segmentation +1

Distractor-aware Event-based Tracking

no code implementations22 Oct 2023 Yingkai Fu, Meng Li, Wenxi Liu, Yuanchen Wang, Jiqing Zhang, BaoCai Yin, Xiaopeng Wei, Xin Yang

We demonstrate that our tracker has superior performance against the state-of-the-art trackers in terms of both accuracy and efficiency.

Object Visual Object Tracking

FetusMapV2: Enhanced Fetal Pose Estimation in 3D Ultrasound

no code implementations30 Oct 2023 Chaoyu Chen, Xin Yang, Yuhao Huang, Wenlong Shi, Yan Cao, Mingyuan Luo, Xindi Hu, Lei Zhue, Lequan Yu, Kejuan Yue, Yuanji Zhang, Yi Xiong, Dong Ni, Weijun Huang

However, accurately estimating the 3D fetal pose in US volume has several challenges, including poor image quality, limited GPU memory for tackling high dimensional data, symmetrical or ambiguous anatomical structures, and considerable variations in fetal poses.

Pose Estimation Self-Supervised Learning

Memory-Efficient Optical Flow via Radius-Distribution Orthogonal Cost Volume

no code implementations6 Dec 2023 Gangwei Xu, Shujun Chen, Hao Jia, Miaojie Feng, Xin Yang

The full 4D cost volume in Recurrent All-Pairs Field Transforms (RAFT) or global matching by Transformer achieves impressive performance for optical flow estimation.

4k Optical Flow Estimation

Optimized Parallelization of Boundary Integral Poisson-Boltzmann Solvers

no code implementations30 Nov 2023 Xin Yang, Elyssa Sliheet, Reece Iriye, Daniel Reynolds, Weihua Geng

By considering the advantages of current algorithms and computer hardware, we focus on the parallelization of the treecode-accelerated boundary integral (TABI) PB solver using the Message Passing Interface (MPI) on CPUs and the direct-sum boundary integral (DSBI) PB solver using KOKKOS on GPUs.

Learning to Prompt Knowledge Transfer for Open-World Continual Learning

no code implementations22 Dec 2023 Yujie Li, Xin Yang, Hao Wang, Xiangkun Wang, Tianrui Li

This paper studies the problem of continual learning in an open-world scenario, referred to as Open-world Continual Learning (OwCL).

Continual Learning Transfer Learning

Federated Continual Learning via Knowledge Fusion: A Survey

no code implementations27 Dec 2023 Xin Yang, Hao Yu, Xin Gao, Hao Wang, Junbo Zhang, Tianrui Li

The key objective of FCL is to fuse heterogeneous knowledge from different clients and retain knowledge of previous tasks while learning on new ones.

Continual Learning Federated Learning

FlowDA: Unsupervised Domain Adaptive Framework for Optical Flow Estimation

no code implementations28 Dec 2023 Miaojie Feng, Longliang Liu, Hao Jia, Gangwei Xu, Xin Yang

This paper introduces FlowDA, an unsupervised domain adaptive (UDA) framework for optical flow estimation.

Optical Flow Estimation

Semantic Segmentation in Multiple Adverse Weather Conditions with Domain Knowledge Retention

no code implementations15 Jan 2024 Xin Yang, Wending Yan, Yuan Yuan, Michael Bi Mi, Robby T. Tan

They struggle to acquire new knowledge while also retaining previously learned knowledge. To address these problems, we propose a semantic segmentation method for multiple adverse weather conditions that incorporates adaptive knowledge acquisition, pseudolabel blending, and weather composition replay.

Multi-target Domain Adaptation Semantic Segmentation +1

Hierarchical Continual Reinforcement Learning via Large Language Model

no code implementations25 Jan 2024 Chaofan Pan, Xin Yang, Hao Wang, Wei Wei, Tianrui Li

Despite the progress in continual reinforcement learning (CRL), existing methods often suffer from insufficient knowledge transfer, particularly when the tasks are diverse.

Language Modelling Large Language Model +3

Thyroid ultrasound diagnosis improvement via multi-view self-supervised learning and two-stage pre-training

no code implementations18 Feb 2024 Jian Wang, Xin Yang, Xiaohong Jia, Wufeng Xue, Rusi Chen, Yanlin Chen, Xiliang Zhu, Lian Liu, Yan Cao, Jianqiao Zhou, Dong Ni, Ning Gu

In this study, we proposed a multi-view contrastive self-supervised method to improve thyroid nodule classification and segmentation performance with limited manual labels.

Classification Segmentation +1

HDRFlow: Real-Time HDR Video Reconstruction with Large Motions

no code implementations6 Mar 2024 Gangwei Xu, Yujin Wang, Jinwei Gu, Tianfan Xue, Xin Yang

HDRFlow has three novel designs: an HDR-domain alignment loss (HALoss), an efficient flow network with a multi-size large kernel (MLK), and a new HDR flow training scheme.

Optical Flow Estimation Video Reconstruction

Open Continual Feature Selection via Granular-Ball Knowledge Transfer

no code implementations15 Mar 2024 Xuemei Cao, Xin Yang, Shuyin Xia, Guoyin Wang, Tianrui Li

To this end, the proposed CFS method combines the strengths of continual learning (CL) with granular-ball computing (GBC), which focuses on constructing a granular-ball knowledge base to detect unknown classes and facilitate the transfer of previously learned knowledge for further feature selection.

Continual Learning feature selection +1

Cannot find the paper you are looking for? You can Submit a new open access paper.