no code implementations • 5 Dec 2024 • Tomas Ortega, Chun-Yin Huang, Xiaoxiao Li, Hamid Jafarkhani
Experimental results confirm that CAFe consistently outperforms distributed learning with direct compression and highlight the compressibility of the client updates with CAFe.
1 code implementation • 31 Oct 2024 • Minghui Chen, Meirui Jiang, Xin Zhang, Qi Dou, Zehua Wang, Xiaoxiao Li
To address these communication cost issues and increase the performance of pre-trained model adaptation in FL, we propose an innovative model interpolation-based local training technique called ``Local Superior Soups.''
no code implementations • 12 Oct 2024 • Wenlong Deng, Yize Zhao, Vala Vakilian, Minghui Chen, Xiaoxiao Li, Christos Thrampoulidis
To push DARE's limits, we introduce DAREx (DARE the eXtreme), which features two algorithmic improvements: (1) DAREx-q, a rescaling factor modification that significantly boosts performance at high pruning rates (e. g., >30 % on COLA and SST2 for encoder models, with even greater gains in decoder models), and (2) DAREx-L2, which combines DARE with AdamR, an in-training method that applies appropriate delta regularization before DPP.
1 code implementation • 2 Oct 2024 • Sadaf Sadeghian, Xiaoxiao Li, Margo Seltzer
First, they focus only on pairwise correlations between regions of the brain, limiting their ability to capture synchronized activity among larger groups of regions.
1 code implementation • 11 Sep 2024 • Atrin Arya, Sana Ayromlou, Armin Saadat, Purang Abolmaesumi, Xiaoxiao Li
Through experimentation in this study, we show that data heterogeneity leads to the phenomenon of catastrophic forgetting during local training.
no code implementations • 3 Jul 2024 • Congzhen Shi, Ryan Rezai, Jiaxi Yang, Qi Dou, Xiaoxiao Li
Our analysis underscores the imperative for advancing towards trustworthy AI in medical image analysis, advocating for a balanced approach that fosters innovation while ensuring ethical and equitable healthcare delivery.
1 code implementation • 1 Jul 2024 • Ruinan Jin, Zikang Xu, Yuan Zhong, Qiongsong Yao, Qi Dou, S. Kevin Zhou, Xiaoxiao Li
The advent of foundation models (FMs) in healthcare offers unprecedented opportunities to enhance medical diagnostics through automated classification and segmentation tasks.
1 code implementation • 9 Jun 2024 • Sana Ayromlou, Teresa Tsang, Purang Abolmaesumi, Xiaoxiao Li
Subsequently, we update the network by combining the synthesized data with new class data and incorporate several losses, including an intra-domain contrastive loss to generalize the deep network trained on the synthesized data to real data, a margin loss to increase separation among previous classes and new ones, and a cosine-normalized cross-entropy loss to alleviate the adverse effects of imbalanced distributions in training data.
no code implementations • 1 Jun 2024 • Liping Yi, Han Yu, Chao Ren, Gang Wang, Xiaoguang Liu, Xiaoxiao Li
(2) The fused representation is then used to construct Matryoshka representations with multi-dimensional and multi-granular embedded representations learned by the global homogeneous model header and the local heterogeneous model header.
no code implementations • 24 May 2024 • Hongyi Peng, Han Yu, Xiaoli Tang, Xiaoxiao Li
Federated learning (FL) enables collaborative machine learning across distributed data owners, but data heterogeneity poses a challenge for model calibration.
1 code implementation • 19 May 2024 • Chun-Yin Huang, Kartik Srinivas, Xin Zhang, Xiaoxiao Li
Conventional Federated Learning (FL) involves collaborative training of a global model while maintaining user data privacy.
no code implementations • 9 May 2024 • Xiaoli Tang, Han Yu, Xiaoxiao Li
To bridge this gap, we propose a first-of-its-kind agent-oriented joint Pricing, Acceptance and Sub-delegation decision support approach for data owners in AFL (PAS-AFL).
1 code implementation • 27 Apr 2024 • Liping Yi, Han Yu, Chao Ren, Heng Zhang, Gang Wang, Xiaoguang Liu, Xiaoxiao Li
2) An iterative training strategy is designed to alternately train the global homogeneous small feature extractor and the local heterogeneous large model for effective global-local knowledge exchange.
no code implementations • 23 Apr 2024 • Chao Ren, Han Yu, Hongyi Peng, Xiaoli Tang, Bo Zhao, Liping Yi, Alysa Ziying Tan, Yulan Gao, Anran Li, Xiaoxiao Li, Zengxiang Li, Qiang Yang
This paper provides a comprehensive survey of the emerging field of Federated Foundation Models (FedFM), elucidating their synergistic relationship and exploring novel methodologies, challenges, and future directions that the FL research field needs to focus on in order to thrive in the age of FMs.
no code implementations • 20 Apr 2024 • Xiaoli Tang, Han Yu, Xiaoxiao Li, Sarit Kraus
To enhance the efficiency in AFL decision support for stakeholders (i. e., data consumers, data owners, and the auctioneer), intelligent agent-based techniques have emerged.
no code implementations • 30 Mar 2024 • Nick Mecklenburg, Yiyou Lin, Xiaoxiao Li, Daniel Holstein, Leonardo Nunes, Sara Malvar, Bruno Silva, Ranveer Chandra, Vijay Aski, Pavan Kumar Reddy Yannam, Tolga Aktas, Todd Hendry
We present a novel dataset generation process that leads to more effective knowledge ingestion through SFT, and our results show considerable performance improvements in Q&A tasks related to out-of-domain knowledge.
no code implementations • 13 Mar 2024 • Yanting Yang, Beidi Zhao, Zhuohao Ni, Yize Zhao, Xiaoxiao Li
Neuroscientific research has revealed that the complex brain network can be organized into distinct functional communities, each characterized by a cohesive group of regions of interest (ROIs) with strong interconnections.
1 code implementation • 10 Mar 2024 • Ruinan Jin, Wenlong Deng, Minghui Chen, Xiaoxiao Li
DNE is capable of mitigating bias both within the FM API embedding and the images themselves.
no code implementations • 28 Feb 2024 • Xiaosong Wang, Xiaofan Zhang, Guotai Wang, Junjun He, Zhongyu Li, Wentao Zhu, Yi Guo, Qi Dou, Xiaoxiao Li, Dequan Wang, Liang Hong, Qicheng Lao, Tong Ruan, Yukun Zhou, Yixue Li, Jie Zhao, Kang Li, Xin Sun, Lifeng Zhu, Shaoting Zhang
The emerging trend of advancing generalist artificial intelligence, such as GPTv4 and Gemini, has reshaped the landscape of research (academia and industry) in machine learning and many other research areas.
no code implementations • 22 Feb 2024 • Wenlong Deng, Blair Chen, Beidi Zhao, Chiyu Zhang, Xiaoxiao Li, Christos Thrampoulidis
In response, this paper proposes a novel method for learning fair text embeddings.
1 code implementation • 2 Feb 2024 • Liping Yi, Han Yu, Chao Ren, Heng Zhang, Gang Wang, Xiaoguang Liu, Xiaoxiao Li
It assigns a shared homogeneous small feature extractor and a local gating network for each client's local heterogeneous large model.
1 code implementation • 1 Jan 2024 • Ruinan Jin, Chun-Yin Huang, Chenyu You, Xiaoxiao Li
Notably, MedCLIP, a vision-language contrastive learning-based medical FM, has been designed using unpaired image-text training.
no code implementations • 22 Dec 2023 • Liang Peng, Songyue Cai, Zongqian Wu, Huifang Shang, Xiaofeng Zhu, Xiaoxiao Li
Nonetheless, applying existing prompt learning methods for the diagnosis of neurological disorder still suffers from two issues: (i) existing methods typically treat all patches equally, despite the fact that only a small number of patches in neuroimaging are relevant to the disease, and (ii) they ignore the structural information inherent in the brain connection network which is crucial for understanding and diagnosing neurological disorders.
1 code implementation • 14 Dec 2023 • Liping Yi, Han Yu, Zhuan Shi, Gang Wang, Xiaoguang Liu, Lizhen Cui, Xiaoxiao Li
Existing MHPFL approaches often rely on a public dataset with the same nature as the learning task, or incur high computation and communication costs.
1 code implementation • 2 Dec 2023 • Weikang Qiu, Huangrui Chu, Selena Wang, Haolan Zuo, Xiaoxiao Li, Yize Zhao, Rex Ying
In response to this gap, we propose a novel method named HYBRID which aims to extract MIMR high-order relationships from fMRI data.
no code implementations • 1 Dec 2023 • Xiaoran Zhang, Daniel H. Pak, Shawn S. Ahn, Xiaoxiao Li, Chenyu You, Lawrence H. Staib, Albert J. Sinusas, Alex Wong, James S. Duncan
To mitigate this, we propose a framework for heteroscedastic image uncertainty estimation that can adaptively reduce the influence of regions with high uncertainty during unsupervised registration.
no code implementations • 18 Nov 2023 • Ziyuan Yang, Zerui Shao, Huijie Huangfu, Hui Yu, Andrew Beng Jin Teoh, Xiaoxiao Li, Hongming Shan, Yi Zhang
Federated learning (FL) is a promising distributed paradigm, eliminating the need for data sharing but facing challenges from data heterogeneity.
1 code implementation • 30 Oct 2023 • Yang Zhao, Jiaxi Yang, Yiling Tao, Lixu Wang, Xiaoxiao Li, Dusit Niyato, H. Vincent Poor
The increasing demand for privacy-preserving machine learning has spurred interest in federated unlearning, which enables the selective removal of data from models trained in federated systems.
1 code implementation • CVPR 2024 • Wenlong Deng, Christos Thrampoulidis, Xiaoxiao Li
Existing Generalized FL (GFL) and Personalized FL (PFL) methods have limitations in balancing performance across both global and local data distributions.
no code implementations • 20 Oct 2023 • Liping Yi, Han Yu, Gang Wang, Xiaoguang Liu, Xiaoxiao Li
Federated learning (FL) is an emerging machine learning paradigm in which a central server coordinates multiple participants (clients) collaboratively to train on decentralized data.
1 code implementation • 24 Jul 2023 • Meirui Jiang, Yuan Zhong, Anjie Le, Xiaoxiao Li, Qi Dou
In this paper, we propose to optimize the trade-off under the context of client-level DP, which focuses on privacy during communications.
no code implementations • 20 Jul 2023 • Xiaoxiao Li, Gaosheng Zhang, An Zhu, Weiyong Li, Shuming Fang, Xiaoyue Yang, Jianchao Zhu
The system focuses on adapting ASR models for low-resource Indian languages and covers all four tracks of the challenge.
1 code implementation • 20 Jul 2023 • Minghui Chen, Meirui Jiang, Qi Dou, Zehua Wang, Xiaoxiao Li
In this paper, we propose a novel federated model soup method (i. e., selective interpolation of model parameters) to optimize the trade-off between local and global performance.
1 code implementation • 24 Jun 2023 • Anushree Bannadabhavi, Soojin Lee, Wenlong Deng, Xiaoxiao Li
Investigating functional magnetic resonance imaging (fMRI)-based brain functional connectome can aid in the understanding and diagnosis of ASD, leading to more effective treatments.
no code implementations • 12 Jun 2023 • Eric Forgoston, Sarah Day, Peter C. de Ruiter, Arjen Doelman, Nienke Hartemink, Alan Hastings, Lia Hemerik, Alexandru Hening, Josef Hofbauer, Sonia Kefi, David A. Kessler, Toni Klauschies, Christian Kuehn, Xiaoxiao Li, John C. Moore, Elly Morrien, Anje-Margriet Neutel, Jelena Pantel, Sebastian J. Schreiber, Leah B. Shaw, Nadav Shnerb, Eric Siero, Laura S. Storch, Michael A. S. Thorne, Ingrid van de Leemput, Ellen van Velzen, Els Weinans
From 08-12 August, 2022, 32 individuals participated in a workshop, Stability and Fluctuations in Complex Ecological Systems, at the Lorentz Center, located in Leiden, The Netherlands.
no code implementations • 6 Jun 2023 • Beidi Zhao, Wenlong Deng, Zi Han, Li, Chen Zhou, Zuhua Gao, Gang Wang, Xiaoxiao Li
We provide appropriate supervision by using slide-level labels to improve the learning of patch-level features.
1 code implementation • 3 Jun 2023 • Ruinan Jin, Minghui Chen, Qiong Zhang, Xiaoxiao Li
In this work, we introduce a novel FL training and unlearning strategy in DNN, termed Forgettable Federated Linear Learning (F^2L^2).
1 code implementation • 1 May 2023 • Konstantin D. Pandl, Chun-Yin Huang, Ivan Beschastnikh, Xiaoxiao Li, Scott Thiebes, Ali Sunyaev
The valuation of data points through DDVal allows to also draw hierarchical conclusions on the contribution of institutions, and we empirically show that the accuracy of DDVal in estimating institutional contributions is higher than existing Shapley value approximation methods for federated learning.
no code implementations • 21 Apr 2023 • Jiaxi Yang, Wenglong Deng, Benlin Liu, Yangsibo Huang, James Zou, Xiaoxiao Li
Specifically, we introduce Generative Model Valuator (GMValuator), the first training-free and model-agnostic approach to provide data valuation for generation tasks.
1 code implementation • 11 Apr 2023 • Xinnan Dai, Caihua Shan, Jie Zheng, Xiaoxiao Li, Dongsheng Li
BFReg-NN starts from gene expression data and is capable of merging most existing biological knowledge into the model, including the regulatory relations among genes or proteins (e. g., gene regulatory networks (GRN), protein-protein interaction networks (PPI)) and the hierarchical relations among genes, proteins and pathways (e. g., several genes/proteins are contained in a pathway).
no code implementations • 30 Mar 2023 • Weina Jin, Xiaoxiao Li, Ghassan Hamarneh
Explainable artificial intelligence (XAI) is motivated by the problem of making AI predictions understandable, transparent, and responsible, as AI becomes increasingly impactful in society and high-stakes domains.
Explainable artificial intelligence Explainable Artificial Intelligence (XAI) +1
1 code implementation • 4 Mar 2023 • Chun-Yin Huang, Ruinan Jin, Can Zhao, Daguang Xu, Xiaoxiao Li
To address this, we propose a new method, called Federated Virtual Learning on Heterogeneous Data with Local-Global Distillation (FedLGD), which trains FL using a smaller synthetic dataset (referred as virtual data) created through a combination of local and global dataset distillation.
no code implementations • 3 Mar 2023 • Yilin Yang, Kamil Adamczewski, Danica J. Sutherland, Xiaoxiao Li, Mijung Park
Maximum mean discrepancy (MMD) is a particularly useful distance metric for differentially private data generation: when used with finite-dimensional features it allows us to summarize and privatize the data distribution once, which we can repeatedly use during generator training without further privacy loss.
2 code implementations • 4 Jan 2023 • Wenlong Deng, Yuan Zhong, Qi Dou, Xiaoxiao Li
In this paper, we propose a novel method for fair representation learning with respect to multi-sensitive attributes.
1 code implementation • 16 Dec 2022 • Jee Seok Yoon, Chenghao Zhang, Heung-Il Suk, Jia Guo, Xiaoxiao Li
To this end, we propose a sequence-aware diffusion model (SADM) for the generation of longitudinal medical images.
1 code implementation • 13 Dec 2022 • Ziyuan Yang, Yingyu Chen, Huijie Huangfu, Maosong Ran, Hui Wang, Xiaoxiao Li, Yi Zhang
To achieve this goal, in this paper, we propose Robust Split Federated Learning (RoS-FL) for U-shaped medical image networks, which is a novel hybrid learning paradigm of FL and SL.
no code implementations • 3 Nov 2022 • Xiaoxiao Li, Zhao Song, Runzhou Tao, Guangyi Zhang
As a leading algorithm in this setting, Federated Average FedAvg, which runs Stochastic Gradient Descent (SGD) in parallel on local devices and averages the sequences only once in a while, have been widely used due to their simplicity and low communication cost.
1 code implementation • 31 Oct 2022 • Ruichen Yao, Ziteng Cui, Xiaoxiao Li, Lin Gu
Fairness is a fundamental requirement for trustworthy and human-centered Artificial Intelligence (AI) system.
no code implementations • 19 Oct 2022 • Ruinan Jin, Xiaoxiao Li
However, given that the FL server cannot access the raw data, it is vulnerable to backdoor attacks, an adversarial by poisoning training data.
no code implementations • 5 Oct 2022 • Qiong Zhang, Jing Peng, Xin Zhang, Aline Talhouk, Gang Niu, Xiaoxiao Li
In federated learning (FL), classifiers (e. g., deep networks) are trained on datasets from multiple data centers without exchanging data across them, which improves the sample efficiency.
no code implementations • 28 Sep 2022 • Chun-Yin Huang, Qi Lei, Xiaoxiao Li
Existing data assessment methods commonly require knowing the labels in advance, which are not feasible to achieve our goal of 'knowing which data to label.'
1 code implementation • 27 Sep 2022 • Chenyu You, Weicheng Dai, Fenglin Liu, Yifei Min, Nicha C. Dvornek, Xiaoxiao Li, David A. Clifton, Lawrence Staib, James S. Duncan
Blindly leveraging all pixels in training hence can lead to the data imbalance issues, and cause deteriorated performance; (2) consistency: it remains unclear whether a segmentation model has learned meaningful and yet consistent anatomical features due to the intra-class variations between different anatomical features; and (3) diversity: the intra-slice correlations within the entire dataset have received significantly less attention.
no code implementations • 18 Aug 2022 • Weina Jin, Jianyu Fan, Diane Gromala, Philippe Pasquier, Xiaoxiao Li, Ghassan Hamarneh
The boundaries of existing explainable artificial intelligence (XAI) algorithms are confined to problems grounded in technical users' demand for explainability.
no code implementations • 7 Aug 2022 • Xiaoxiao Li, Zhao Song, Jiaming Yang
Unlike the convergence analysis in classical centralized training that relies on the gradient direction, it is significantly harder to analyze the convergence in FAL for three reasons: 1) the complexity of min-max optimization, 2) model not updating in the gradient direction due to the multi-local updates on the client-side before aggregation and 3) inter-client heterogeneity.
1 code implementation • 5 Aug 2022 • Ziteng Cui, Yingying Zhu, Lin Gu, Guo-Jun Qi, Xiaoxiao Li, Renrui Zhang, Zenghui Zhang, Tatsuya Harada
Image restoration algorithms such as super resolution (SR) are indispensable pre-processing modules for object detection in low quality images.
1 code implementation • 2 Jul 2022 • Ruinan Jin, Xiaoxiao Li
In this study, we propose a way of attacking federated GAN (FedGAN) by treating the discriminator with a commonly used data poisoning strategy in backdoor attack classification models.
1 code implementation • 30 Jun 2022 • Hejie Cui, Wei Dai, Yanqiao Zhu, Xiaoxiao Li, Lifang He, Carl Yang
Mapping the connections of the human brain as a network is one of the most pervasive paradigms in neuroscience.
1 code implementation • 27 Jun 2022 • Meirui Jiang, Hongzheng Yang, Xiaoxiao Li, Quande Liu, Pheng-Ann Heng, Qi Dou
Despite recent progress on semi-supervised federated learning (FL) for medical image diagnosis, the problem of imbalanced class distributions among unlabeled clients is still unsolved for real-world use.
1 code implementation • 26 Jun 2022 • Sana Ayromlou, Purang Abolmaesumi, Teresa Tsang, Xiaoxiao Li
Here, we propose a novel data-free class incremental learning framework that first synthesizes data from the model trained on previous classes to generate a \ours.
1 code implementation • 8 Jun 2022 • Ziyuan Yang, Wenjun Xia, Zexin Lu, Yingyu Chen, Xiaoxiao Li, Yi Zhang
The basic assumption of HyperFed is that the optimization problem for each institution can be divided into two parts: the local data adaption problem and the global CT imaging problem, which are implemented by an institution-specific hypernetwork and a global-sharing imaging network, respectively.
1 code implementation • 2 Jun 2022 • Nan Wang, Shaohui Lin, Xiaoxiao Li, Ke Li, Yunhang Shen, Yue Gao, Lizhuang Ma
U-Nets have achieved tremendous success in medical image segmentation.
1 code implementation • 7 Apr 2022 • Nan Lu, Zhao Wang, Xiaoxiao Li, Gang Niu, Qi Dou, Masashi Sugiyama
We propose federation of unsupervised learning (FedUL), where the unlabeled data are transformed into surrogate labeled data for each of the clients, a modified model is trained by supervised FL, and the wanted model is recovered from the modified model.
1 code implementation • 17 Mar 2022 • Liang Peng, Nan Wang, Jie Xu, Xiaofeng Zhu, Xiaoxiao Li
To improve fMRI representation learning and classification under a label-efficient setting, we propose a novel and theory-driven self-supervised learning (SSL) framework on GCNs, namely Graph CCA for Temporal self-supervised learning on fMRI analysis GATE.
1 code implementation • 12 Mar 2022 • Weina Jin, Xiaoxiao Li, Ghassan Hamarneh
The evaluation and MSFI metric can guide the design and selection of XAI algorithms to meet clinical requirements on multi-modal explanation.
Explainable Artificial Intelligence (XAI) Feature Importance
1 code implementation • 16 Feb 2022 • Weina Jin, Xiaoxiao Li, Mostafa Fatehi, Ghassan Hamarneh
Following the guidelines, we conducted a systematic evaluation on a novel problem of multi-modal medical image explanation with two clinical tasks, and proposed new evaluation metrics accordingly.
Computational Efficiency Explainable artificial intelligence +2
no code implementations • 7 Jan 2022 • Ziteng Cui, Yingying Zhu, Lin Gu, Guo-Jun Qi, Xiaoxiao Li, Peng Gao, Zenghui Zhang, Tatsuya Harada
Image restoration algorithms such as super resolution (SR) are indispensable pre-processing modules for object detection in degraded images.
no code implementations • 19 Dec 2021 • Liang Peng, Nan Wang, Nicha Dvornek, Xiaofeng Zhu, Xiaoxiao Li
Then we train a global GCN node classifier across institutions using a federated graph learning platform.
no code implementations • 2 Dec 2021 • Yifei HUANG, Xiaoxiao Li, Lijin Yang, Lin Gu, Yingying Zhu, Hirofumi Seo, Qiuming Meng, Tatsuya Harada, Yoichi Sato
Then we design a novel Auxiliary Attention Block (AAB) to allow information from SAN to be utilized by the backbone encoder to focus on selective areas.
no code implementations • 19 Oct 2021 • Meirui Jiang, Xiaoxiao Li, Xiaofei Zhang, Michael Kamp, Qi Dou
In this work, we propose a unified framework to tackle the non-iid issues for internal and external clients together.
no code implementations • 8 Oct 2021 • Li Fu, Xiaoxiao Li, Runyu Wang, Lu Fan, Zhengchen Zhang, Meng Chen, Youzheng Wu, Xiaodong He
End-to-end Automatic Speech Recognition (ASR) models are usually trained to optimize the loss of the whole token sequence, while neglecting explicit phonemic-granularity supervision.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +3
no code implementations • ICLR 2022 • Nan Lu, Zhao Wang, Xiaoxiao Li, Gang Niu, Qi Dou, Masashi Sugiyama
We propose federation of unsupervised learning (FedUL), where the unlabeled data are transformed into surrogate labeled data for each of the clients, a modified model is trained by supervised FL, and the wanted model is recovered from the modified model.
no code implementations • 29 Sep 2021 • Xiaoxiao Li, Zhao Song, Jiaming Yang
Unlike the convergence analysis in centralized training that relies on the gradient direction, it is significantly harder to analyze the convergence in FAL for two reasons: 1) the complexity of min-max optimization, and 2) model not updating in the gradient direction due to the multi-local updates on the client-side before aggregation.
no code implementations • 24 Sep 2021 • Di Fan, Yifan Wu, Xiaoxiao Li
Distributed and collaborative learning is an approach to involve training models in massive, heterogeneous, and distributed data sources, also known as nodes.
1 code implementation • 8 Sep 2021 • Yangsibo Huang, Xiaoxiao Li, Kai Li
In this paper, we propose a new method called Ensembled Membership Auditing (EMA) for auditing data removal to overcome these limitations.
no code implementations • 11 Jul 2021 • Weina Jin, Xiaoxiao Li, Ghassan Hamarneh
The maps highlight important features for AI model's prediction.
1 code implementation • 11 Jul 2021 • Hejie Cui, Wei Dai, Yanqiao Zhu, Xiaoxiao Li, Lifang He, Carl Yang
Interpretable brain network models for disease prediction are of great value for the advancement of neuroscience.
1 code implementation • NeurIPS 2021 • Ke Zhang, Carl Yang, Xiaoxiao Li, Lichao Sun, Siu Ming Yiu
Graphs have been widely used in data mining and machine learning due to their unique representation of real-world objects and their interactions.
no code implementations • 11 May 2021 • Baihe Huang, Xiaoxiao Li, Zhao Song, Xin Yang
Nevertheless, training analysis of neural networks in FL is non-trivial for two reasons: first, the objective loss function we are optimizing is non-smooth and non-convex, and second, we are even not updating in the gradient direction.
no code implementations • 15 Apr 2021 • Nicha C. Dvornek, Xiaoxiao Li, Juntang Zhuang, Pamela Ventola, James S. Duncan
Heterogeneous presentation of a neurological disorder suggests potential differences in the underlying pathophysiological changes that occur in the brain.
1 code implementation • 7 Mar 2021 • Xiaoxiao Li, Ziteng Cui, Yifan Wu, Lin Gu, Tatsuya Harada
To tackle this issue, we propose an adversarial multi-task training strategy to simultaneously mitigate and detect bias in the deep learning-based medical image analysis system.
4 code implementations • ICLR 2021 • Xiaoxiao Li, Meirui Jiang, Xiaofei Zhang, Michael Kamp, Qi Dou
The emerging paradigm of federated learning (FL) strives to enable collaborative training of deep models on the network edge without centrally aggregating raw data and hence improving data privacy.
no code implementations • ICLR 2021 • Sitan Chen, Xiaoxiao Li, Zhao Song, Danyang Zhuo
In this work, we examine the security of InstaHide, a scheme recently proposed by \cite{hsla20} for preserving the security of private datasets in the context of distributed learning.
no code implementations • 9 Dec 2020 • Xiaoxiao Li, Rabah Al-Zaidy, Amy Zhang, Stefan Baral, Le Bao, C. Lee Giles
Conclusions: In sum, the automated procedure of document classification presented here could improve both the precision and efficiency of systematic reviews, as well as facilitating live reviews, where reviews are updated regularly.
no code implementations • 23 Nov 2020 • Sitan Chen, Xiaoxiao Li, Zhao Song, Danyang Zhuo
In this work, we examine the security of InstaHide, a scheme recently proposed by [Huang, Song, Li and Arora, ICML'20] for preserving the security of private datasets in the context of distributed learning.
no code implementations • 22 Oct 2020 • Xiaoxiao Li, Yangsibo Huang, Binghui Peng, Zhao Song, Kai Li
To address the issue that deep neural networks (DNNs) are vulnerable to model inversion attacks, we design an objective function, which adjusts the separability of the hidden data representations, as a way to control the trade-off between data utility and vulnerability to inversion attacks.
1 code implementation • 28 Sep 2020 • Rui Xu, Minghao Guo, Jiaqi Wang, Xiaoxiao Li, Bolei Zhou, Chen Change Loy
By bringing together the best of both paradigms, we propose a new deep inpainting framework where texture generation is guided by a texture memory of patch samples extracted from unmasked regions.
no code implementations • 29 Jul 2020 • Xiaoxiao Li, Yuan Zhou, Nicha C. Dvornek, Muhan Zhang, Juntang Zhuang, Pamela Ventola, James S. Duncan
We propose an interpretable GNN framework with a novel salient region selection mechanism to determine neurological brain biomarkers associated with disorders.
2 code implementations • ECCV 2020 • Guodong Xu, Ziwei Liu, Xiaoxiao Li, Chen Change Loy
Knowledge distillation, which involves extracting the "dark knowledge" from a teacher network to guide the learning of a student network, has emerged as an important technique for model compression and transfer learning.
Ranked #40 on Knowledge Distillation on ImageNet
2 code implementations • ICML 2020 • Juntang Zhuang, Nicha Dvornek, Xiaoxiao Li, Sekhar Tatikonda, Xenophon Papademetris, James Duncan
Neural ordinary differential equations (NODEs) have recently attracted increasing attention; however, their empirical performance on benchmark tasks (e. g. image classification) are significantly inferior to discrete-layer models.
no code implementations • 21 May 2020 • Minjia Shi, Shukai Wang, Xiaoxiao Li, Denis S. Krotov
A frequency $n$-cube $F^n(4;2, 2)$ is an $n$-dimensional $4$-by-...-by-$4$ array filled by $0$s and $1$s such that each line contains exactly two $1$s.
Combinatorics Discrete Mathematics 05B15
no code implementations • 15 May 2020 • Xiaoxiao Li, Xiaopeng Guo, Liye Mei, Mingyu Shang, Jie Gao, Maojing Shu, Xiang Wang
The core of VP model is to decompose the light source into light intensity and light spatial distribution to describe the perception process of HVS, offering refinement estimation of illumination and reflectance.
no code implementations • 11 May 2020 • Li Fu, Xiaoxiao Li, Libo Zi, Zhengchen Zhang, Youzheng Wu, Xiaodong He, BoWen Zhou
In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +3
no code implementations • 26 Apr 2020 • Li Fu, Xiaoxiao Li, Libo Zi
To improve the performance of RNN-T for Mandarin speech recognition task, a novel transformer transducer with the combination architecture of self-attention transformer and RNN is proposed.
no code implementations • 2 Feb 2020 • Xiaoxiao Li, Joao Saude
GNNs combine node features, connection patterns, and graph structure by using a neural network to embed node information and pass it through edges in the graph.
1 code implementation • 16 Jan 2020 • Xiaoxiao Li, Yufeng Gu, Nicha Dvornek, Lawrence Staib, Pamela Ventola, James S. Duncan
However, to effectively train a high-quality deep learning model, the aggregation of a significant amount of patient information is required.
no code implementations • 15 Oct 2019 • Nicha C. Dvornek, Xiaoxiao Li, Juntang Zhuang, James S. Duncan
The addition of the generative model constrains the network to learn functional communities represented by the LSTM nodes that are both consistent with the data generation as well as useful for the classification task.
no code implementations • 8 Oct 2019 • José Ignacio Orlando, Huazhu Fu, João Barbossa Breda, Karel van Keer, Deepti. R. Bathula, Andrés Diaz-Pinto, Ruogu Fang, Pheng-Ann Heng, Jeyoung Kim, Joonho Lee, Joonseok Lee, Xiaoxiao Li, Peng Liu, Shuai Lu, Balamurali Murugesan, Valery Naranjo, Sai Samarth R. Phaye, Sharath M. Shankaranarayana, Apoorva Sikka, Jaemin Son, Anton Van Den Hengel, Shujun Wang, Junyan Wu, Zifeng Wu, Guanghui Xu, Yongli Xu, Pengshuai Yin, Fei Li, Yanwu Xu, Xiulan Zhang, Hrvoje Bogunović
As part of REFUGE, we have publicly released a data set of 1200 fundus images with ground truth segmentations and clinical glaucoma labels, currently the largest existing one.
1 code implementation • 30 Sep 2019 • Juntang Zhuang, Nicha C. Dvornek, Xiaoxiao Li, Junlin Yang, James S. Duncan
We can determine the decision boundary of a linear classifier in the feature space; since the transform is invertible, we can invert the decision boundary from the feature space to the input space.
no code implementations • 25 Sep 2019 • Juntang Zhuang, Nicha Dvornek, Xiaoxiao Li, James S. Duncan
Inspired by neural ordinary differential equation (NODE) for data in the Euclidean domain, we extend the idea of continuous-depth models to graph data, and propose graph ordinary differential equation (GODE).
no code implementations • 9 Aug 2019 • Xiaoxiao Li, Nicha C. Dvornek, Juntang Zhuang, Pamela Ventola, James Duncan
Here, we model the whole brain fMRI as a graph, which preserves geometrical and temporal information and use a Graph Neural Network (GNN) to learn from the graph-structured fMRI data.
1 code implementation • 23 Jul 2019 • Juntang Zhuang, Nicha C. Dvornek, Xiaoxiao Li, Pamela Ventola, James S. Duncan
Recently deep learning methods have achieved success in the classification task of ASD using fMRI data.
no code implementations • 2 Jul 2019 • Xiaoxiao Li, Nicha C. Dvornek, Yuan Zhou, Juntang Zhuang, Pamela Ventola, James S. Duncan
Our pipeline can be generalized to other graph feature importance interpretation problems.
144 code implementations • 17 Jun 2019 • Kai Chen, Jiaqi Wang, Jiangmiao Pang, Yuhang Cao, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jiarui Xu, Zheng Zhang, Dazhi Cheng, Chenchen Zhu, Tianheng Cheng, Qijie Zhao, Buyu Li, Xin Lu, Rui Zhu, Yue Wu, Jifeng Dai, Jingdong Wang, Jianping Shi, Wanli Ouyang, Chen Change Loy, Dahua Lin
In this paper, we introduce the various features of this toolbox.
2 code implementations • CVPR 2019 • Rui Xu, Xiaoxiao Li, Bolei Zhou, Chen Change Loy
Then the synthesized flow field is used to guide the propagation of pixels to fill up the missing regions in the video.
Ranked #8 on Video Inpainting on DAVIS
One-shot visual object segmentation Optical Flow Estimation +2
5 code implementations • CVPR 2019 • Kai Chen, Jiangmiao Pang, Jiaqi Wang, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jianping Shi, Wanli Ouyang, Chen Change Loy, Dahua Lin
In exploring a more effective approach, we find that the key to a successful instance segmentation cascade is to fully leverage the reciprocal relationship between detection and segmentation.
Ranked #32 on Object Detection on COCO-O
no code implementations • 14 Dec 2018 • Xiaoxiao Li, Nicha C. Dvornek, Yuan Zhou, Juntang Zhuang, Pamela Ventola, James S. Duncan
Cooperative game theory is advantageous here because it directly considers the interaction between features and can be applied to any machine learning method, making it a novel, more accurate way of determining instance-wise biomarker importance from deep learning models.
no code implementations • 8 Nov 2018 • Xiaoxiao Li, Vivek Singh, Yifan Wu, Klaus Kirchberg, James Duncan, Ankur Kapoor
Tracking organ motion is important in image-guided interventions, but motion annotations are not always easily available.
no code implementations • 2 Nov 2018 • Xiaoxiao Li, Junyan Wu, Eric Z. Chen, Hongda Jiang
In this paper, we propose a method to interpret the deep learning classification findings.
no code implementations • 23 Aug 2018 • Xiaoxiao Li, Nicha C. Dvornek, Juntang Zhuang, Pamela Ventola, James S. Duncan
Therefore, in this work, we address the problem of interpreting reliable biomarkers associated with identifying ASD; specifically, we propose a 2-stage method that classifies ASD and control subjects using fMRI images and interprets the saliency features activated by the classifier.
no code implementations • ECCV 2018 • Xiaoxiao Li, Chen Change Loy
The problem of video object segmentation can become extremely challenging when multiple instances co-exist.
3 code implementations • 1 Aug 2017 • Xiaoxiao Li, Yuankai Qi, Zhe Wang, Kai Chen, Ziwei Liu, Jianping Shi, Ping Luo, Xiaoou Tang, Chen Change Loy
Specifically, our Video Object Segmentation with Re-identification (VS-ReID) model includes a mask propagation module and a ReID module.
1 code implementation • CVPR 2017 • Xiaoxiao Li, Ziwei Liu, Ping Luo, Chen Change Loy, Xiaoou Tang
Third, in comparison to MC, LC is an end-to-end trainable framework, allowing joint learning of all sub-models.
Ranked #22 on Semantic Segmentation on PASCAL VOC 2012 test
no code implementations • 23 Jun 2016 • Ziwei Liu, Xiaoxiao Li, Ping Luo, Chen Change Loy, Xiaoou Tang
Semantic segmentation tasks can be well modeled by Markov Random Field (MRF).
1 code implementation • ICCV 2015 • Ziwei Liu, Xiaoxiao Li, Ping Luo, Chen Change Loy, Xiaoou Tang
This paper addresses semantic image segmentation by incorporating rich information into Markov Random Field (MRF), including high-order relations and mixture of label contexts.
Ranked #91 on Semantic Segmentation on Cityscapes test