Search Results for author: Zhisong Pan

Found 14 papers, 3 papers with code

On the Convergence of Federated Averaging under Partial Participation for Over-parameterized Neural Networks

no code implementations9 Oct 2023 Xin Liu, Wei Li, Dazhi Zhan, Yu Pan, Xin Ma, Yu Ding, Zhisong Pan

Federated learning (FL) is a widely employed distributed paradigm for collaboratively training machine learning models from multiple clients without sharing local data.

Federated Learning

A high-resolution dynamical view on momentum methods for over-parameterized neural networks

no code implementations8 Aug 2022 Xin Liu, Wei Tao, Jun Wang, Zhisong Pan

Due to the simplicity and efficiency of the first-order gradient method, it has been widely used in training neural networks.

FedSSO: A Federated Server-Side Second-Order Optimization Algorithm

no code implementations20 Jun 2022 Xin Ma, Renyi Bao, Jinpeng Jiang, Yang Liu, Arthur Jiang, Jun Yan, Xin Liu, Zhisong Pan

In this work, we propose FedSSO, a server-side second-order optimization method for federated learning (FL).

Federated Learning

Multiple Domain Cyberspace Attack and Defense Game Based on Reward Randomization Reinforcement Learning

no code implementations23 May 2022 Lei Zhang, Yu Pan, Yi Liu, Qibin Zheng, Zhisong Pan

In order to improve the defense ability of defender, a game model based on reward randomization reinforcement learning is proposed.

reinforcement-learning Reinforcement Learning (RL)

A Convergence Analysis of Nesterov's Accelerated Gradient Method in Training Deep Linear Neural Networks

no code implementations18 Apr 2022 Xin Liu, Wei Tao, Zhisong Pan

To the best of our knowledge, this is the first theoretical guarantee for the convergence of NAG to the global minimum in training deep neural networks.

Adversarial Attack via Dual-Stage Network Erosion

1 code implementation1 Jan 2022 Yexin Duan, Junhua Zou, Xingyu Zhou, Wu Zhang, Jin Zhang, Zhisong Pan

Deep neural networks are vulnerable to adversarial examples, which can fool deep models by adding subtle perturbations.

Adversarial Attack

Provable Convergence of Nesterov's Accelerated Gradient Method for Over-Parameterized Neural Networks

no code implementations5 Jul 2021 Xin Liu, Zhisong Pan, Wei Tao

Despite the fact that the objective function is non-convex and non-smooth, we show that NAG converges to a global minimum at a non-asymptotic linear rate $(1-\Theta(1/\sqrt{\kappa}))^t$, where $\kappa > 1$ is the condition number of a gram matrix and $t$ is the number of the iterations.

Gradient Descent Averaging and Primal-dual Averaging for Strongly Convex Optimization

no code implementations29 Dec 2020 Wei Tao, Wei Li, Zhisong Pan, Qing Tao

In order to remove this factor, we first develop gradient descent averaging (GDA), which is a general projection-based dual averaging algorithm in the strongly convex setting.

Weakness Analysis of Cyberspace Configuration Based on Reinforcement Learning

no code implementations9 Jul 2020 Lei Zhang, Wei Bai, Shize Guo, Shiming Xia, Hongmei Li, Zhisong Pan

To achieve these results, we pose finding attack paths as a Reinforcement Learning (RL) problem and train an agent to find multiple domain attack paths.

reinforcement-learning Reinforcement Learning (RL)

Making Adversarial Examples More Transferable and Indistinguishable

2 code implementations8 Jul 2020 Junhua Zou, Yexin Duan, Boyu Li, Wu Zhang, Yu Pan, Zhisong Pan

Fast gradient sign attack series are popular methods that are used to generate adversarial examples.

Multi-task Feature Selection based Anomaly Detection

no code implementations17 Mar 2014 Longqi Yang, Yibing Wang, Zhisong Pan, Guyu Hu

In this paper, we apply the multi-task feature selection in network anomaly detection area which provides a powerful method to gather information from multiple traffic and detect anomalies on it simultaneously.

Anomaly Detection feature selection +1

Cannot find the paper you are looking for? You can Submit a new open access paper.