Search Results for author: Ming Ding

Found 52 papers, 22 papers with code

CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers

1 code implementation29 May 2022 Wenyi Hong, Ming Ding, Wendi Zheng, Xinghan Liu, Jie Tang

Large-scale pretrained transformers have created milestones in text (GPT-3) and text-to-image (DALL-E and CogView) generation.

Text-to-Video Generation Video Generation

CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers

1 code implementation28 Apr 2022 Ming Ding, Wendi Zheng, Wenyi Hong, Jie Tang

The development of the transformer-based text-to-image models are impeded by its slow generation and complexity for high-resolution images.

Language Modelling Super-Resolution +2

Vertical Federated Learning: Challenges, Methodologies and Experiments

no code implementations9 Feb 2022 Kang Wei, Jun Li, Chuan Ma, Ming Ding, Sha Wei, Fan Wu, Guihai Chen, Thilina Ranbaduge

As a special architecture in FL, vertical FL (VFL) is capable of constructing a hyper ML model by embracing sub-models from different clients.

Federated Learning

Negative-ResNet: Noisy Ambulatory Electrocardiogram Signal Classification Scheme

no code implementations25 Jan 2022 Zijiao Chen, Zihuai Lin, Peng Wang, Ming Ding

With recently successful applications of deep learning in computer vision and general signal processing, deep learning has shown many unique advantages in medical signal processing.

Classification Computer Vision

Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networks

1 code implementation30 Dec 2021 Qingsong Lv, Ming Ding, Qiang Liu, Yuxiang Chen, Wenzheng Feng, Siming He, Chang Zhou, Jianguo Jiang, Yuxiao Dong, Jie Tang

Heterogeneous graph neural networks (HGNNs) have been blossoming in recent years, but the unique data processing and evaluation setups used by each work obstruct a full understanding of their advancements.

Adaptive Diffusion in Graph Neural Networks

no code implementations NeurIPS 2021 Jialin Zhao, Yuxiao Dong, Ming Ding, Evgeny Kharlamov, Jie Tang

Notably, message passing based GNNs, e. g., graph convolutional networks, leverage the immediate neighbors of each node during the aggregation process, and recently, graph diffusion convolution (GDC) is proposed to expand the propagation neighborhood by leveraging generalized graph diffusion.

Federated Learning for Smart Healthcare: A Survey

no code implementations16 Nov 2021 Dinh C. Nguyen, Quoc-Viet Pham, Pubudu N. Pathirana, Ming Ding, Aruna Seneviratne, Zihuai Lin, Octavia A. Dobre, Won-Joo Hwang

Recent advances in communication technologies and Internet-of-Medical-Things have transformed smart healthcare enabled by artificial intelligence (AI).

Federated Learning

Cooperative Task Offloading and Block Mining in Blockchain-based Edge Computing with Multi-agent Deep Reinforcement Learning

no code implementations29 Sep 2021 Dinh C. Nguyen, Ming Ding, Pubudu N. Pathirana, Aruna Seneviratne, Jun Li, H. Vincent Poor

The convergence of mobile edge computing (MEC) and blockchain is transforming the current computing services in mobile networks, by offering task offloading solutions with security enhancement empowered by blockchain mining.

Edge-computing

BEdgeHealth: A Decentralized Architecture for Edge-based IoMT Networks Using Blockchain

no code implementations29 Sep 2021 Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding, Aruna Seneviratne

The healthcare industry has witnessed significant transformations in e-health services by using mobile edge computing (MEC) and blockchain to facilitate healthcare operations.

Edge-computing

6G Internet of Things: A Comprehensive Survey

no code implementations11 Aug 2021 Dinh C. Nguyen, Ming Ding, Pubudu N. Pathirana, Aruna Seneviratne, Jun Li, Dusit Niyato, Octavia Dobre, H. Vincent Poor

The sixth generation (6G) wireless communication networks are envisioned to revolutionize customer services and applications via the Internet of Things (IoT) towards a future of fully intelligent and autonomous systems.

Autonomous Driving

Low-Latency Federated Learning over Wireless Channels with Differential Privacy

no code implementations20 Jun 2021 Kang Wei, Jun Li, Chuan Ma, Ming Ding, Cailian Chen, Shi Jin, Zhu Han, H. Vincent Poor

Then, we convert the MAMAB to a max-min bipartite matching problem at each communication round, by estimating rewards with the upper confidence bound (UCB) approach.

Federated Learning

Federated Learning for Industrial Internet of Things in Future Industries

no code implementations31 May 2021 Dinh C. Nguyen, Ming Ding, Pubudu N. Pathirana, Aruna Seneviratne, Jun Li, Dusit Niyato, H. Vincent Poor

The Industrial Internet of Things (IIoT) offers promising opportunities to transform the operation of industrial systems and becomes a key enabler for future industries.

Federated Learning

M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformers

no code implementations NeurIPS 2021 Zhu Zhang, Jianxin Ma, Chang Zhou, Rui Men, Zhikang Li, Ming Ding, Jie Tang, Jingren Zhou, Hongxia Yang

Conditional image synthesis aims to create an image according to some multi-modal guidance in the forms of textual descriptions, reference images, and image blocks to preserve, as well as their combinations.

Image Generation

CogView: Mastering Text-to-Image Generation via Transformers

3 code implementations NeurIPS 2021 Ming Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng, Chang Zhou, Da Yin, Junyang Lin, Xu Zou, Zhou Shao, Hongxia Yang, Jie Tang

Text-to-Image generation in the general domain has long been an open problem, which requires both a powerful generative model and cross-modal understanding.

Ranked #22 on Text-to-Image Generation on COCO (using extra training data)

Super-Resolution Text to image generation +1

UFC-BERT: Unifying Multi-Modal Controls for Conditional Image Synthesis

no code implementations NeurIPS 2021 Zhu Zhang, Jianxin Ma, Chang Zhou, Rui Men, Zhikang Li, Ming Ding, Jie Tang, Jingren Zhou, Hongxia Yang

Conditional image synthesis aims to create an image according to some multi-modal guidance in the forms of textual descriptions, reference images, and image blocks to preserve, as well as their combinations.

Image Generation

Federated Learning with Unreliable Clients: Performance Analysis and Mechanism Design

1 code implementation10 May 2021 Chuan Ma, Jun Li, Ming Ding, Kang Wei, Wen Chen, H. Vincent Poor

Owing to the low communication costs and privacy-promoting capabilities, Federated Learning (FL) has become a promising tool for training effective machine learning models among distributed clients.

Federated Learning

Federated Learning for Internet of Things: A Comprehensive Survey

no code implementations16 Apr 2021 Dinh C. Nguyen, Ming Ding, Pubudu N. Pathirana, Aruna Seneviratne, Jun Li, H. Vincent Poor

The Internet of Things (IoT) is penetrating many facets of our daily life with the proliferation of intelligent services and applications empowered by artificial intelligence (AI).

Federated Learning

Realistic Differentially-Private Transmission Power Flow Data Release

1 code implementation25 Mar 2021 David Smith, Frederik Geth, Elliott Vercoe, Andrew Feutrill, Ming Ding, Jonathan Chan, James Foster, Thierry Rakotoarivelo

For the modeling, design and planning of future energy transmission networks, it is vital for stakeholders to access faithful and useful power flow data, while provably maintaining the privacy of business confidentiality of service providers.

GPT Understands, Too

4 code implementations18 Mar 2021 Xiao Liu, Yanan Zheng, Zhengxiao Du, Ming Ding, Yujie Qian, Zhilin Yang, Jie Tang

On the SuperGlue benchmark, GPTs achieve comparable and sometimes better performance to similar-sized BERTs in supervised learning.

Benchmark Natural Language Understanding +1

GLM: General Language Model Pretraining with Autoregressive Blank Infilling

1 code implementation ACL 2022 Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, Jie Tang

On a wide range of tasks across NLU, conditional and unconditional generation, GLM outperforms BERT, T5, and GPT given the same model sizes and data, and achieves the best performance from a single pretrained model with 1. 25x parameters of BERT Large , demonstrating its generalizability to different downstream tasks.

Abstractive Text Summarization Classification +4

DP-Image: Differential Privacy for Image Data in Feature Space

no code implementations12 Mar 2021 Bo Liu, Ming Ding, Hanyu Xue, Tianqing Zhu, Dayong Ye, Li Song, Wanlei Zhou

The excessive use of images in social networks, government databases, and industrial applications has posed great privacy risks and raised serious concerns from the public.

IdentityDP: Differential Private Identification Protection for Face Images

no code implementations2 Mar 2021 Yunqian Wen, Li Song, Bo Liu, Ming Ding, Rong Xie

We propose IdentityDP, a face anonymization framework that combines a data-driven deep neural network with a differential privacy (DP) mechanism.

Computer Vision De-identification +3

M6: A Chinese Multimodal Pretrainer

no code implementations1 Mar 2021 Junyang Lin, Rui Men, An Yang, Chang Zhou, Ming Ding, Yichang Zhang, Peng Wang, Ang Wang, Le Jiang, Xianyan Jia, Jie Zhang, Jianwei Zhang, Xu Zou, Zhikang Li, Xiaodong Deng, Jie Liu, Jinbao Xue, Huiling Zhou, Jianxin Ma, Jin Yu, Yong Li, Wei Lin, Jingren Zhou, Jie Tang, Hongxia Yang

In this work, we construct the largest dataset for multimodal pretraining in Chinese, which consists of over 1. 9TB images and 292GB texts that cover a wide range of domains.

Image Generation

Covert Model Poisoning Against Federated Learning: Algorithm Design and Optimization

no code implementations28 Jan 2021 Kang Wei, Jun Li, Ming Ding, Chuan Ma, Yo-Seb Jeon, H. Vincent Poor

An attacker in FL may control a number of participant clients, and purposely craft the uploaded model parameters to manipulate system outputs, namely, model poisoning (MP).

Federated Learning Model Poisoning

Blockchain Assisted Decentralized Federated Learning (BLADE-FL): Performance Analysis and Resource Allocation

no code implementations18 Jan 2021 Jun Li, Yumeng Shao, Kang Wei, Ming Ding, Chuan Ma, Long Shi, Zhu Han, H. Vincent Poor

Focusing on this problem, we explore the impact of lazy clients on the learning performance of BLADE-FL, and characterize the relationship among the optimal K, the learning parameters, and the proportion of lazy clients.

Federated Learning

Generalizing Graph Convolutional Networks

1 code implementation1 Jan 2021 Jialin Zhao, Yuxiao Dong, Jie Tang, Ming Ding, Kuansan Wang

Graph convolutional networks (GCNs) have emerged as a powerful framework for mining and learning with graphs.

F-manifold color algebras

no code implementations22 Dec 2020 Ming Ding, Zhiqi Chen, Jifu Li

In this paper, we introduce the notion of F-manifold color algebras and study their properties which extend some results for F-manifold algebras.

Rings and Algebras

Blockchain Assisted Decentralized Federated Learning (BLADE-FL) with Lazy Clients

no code implementations2 Dec 2020 Jun Li, Yumeng Shao, Ming Ding, Chuan Ma, Kang Wei, Zhu Han, H. Vincent Poor

The proposed BLADE-FL has a good performance in terms of privacy preservation, tamper resistance, and effective cooperation of learning.

Federated Learning

CogLTX: Applying BERT to Long Texts

1 code implementation NeurIPS 2020 Ming Ding, Chang Zhou, Hongxia Yang, Jie Tang

BERTs are incapable of processing long texts due to its quadratically increasing memory and time consumption.

Text Classification

When Machine Learning Meets Privacy: A Survey and Outlook

no code implementations24 Nov 2020 Bo Liu, Ming Ding, Sina Shaham, Wenny Rahayu, Farhad Farokhi, Zihuai Lin

The newly emerged machine learning (e. g. deep learning) methods have become a strong driving force to revolutionize a wide range of industries, such as smart healthcare, financial technology, and surveillance systems.

When Federated Learning Meets Blockchain: A New Distributed Learning Paradigm

no code implementations20 Sep 2020 Chuan Ma, Jun Li, Ming Ding, Long Shi, Taotao Wang, Zhu Han, H. Vincent Poor

Motivated by the explosive computing capabilities at end user equipments, as well as the growing privacy concerns over sharing sensitive raw data, a new machine learning paradigm, named federated learning (FL) has emerged.

Networking and Internet Architecture

RDP-GAN: A Rényi-Differential Privacy based Generative Adversarial Network

1 code implementation4 Jul 2020 Chuan Ma, Jun Li, Ming Ding, Bo Liu, Kang Wei, Jian Weng, H. Vincent Poor

Generative adversarial network (GAN) has attracted increasing attention recently owing to its impressive ability to generate realistic samples with high privacy protection.

Understanding Negative Sampling in Graph Representation Learning

2 code implementations20 May 2020 Zhen Yang, Ming Ding, Chang Zhou, Hongxia Yang, Jingren Zhou, Jie Tang

To the best of our knowledge, we are the first to derive the theory and quantify that the negative sampling distribution should be positively but sub-linearly correlated to their positive sampling distribution.

Graph Learning Graph Representation Learning +2

User-Level Privacy-Preserving Federated Learning: Analysis and Performance Optimization

no code implementations29 Feb 2020 Kang Wei, Jun Li, Ming Ding, Chuan Ma, Hang Su, Bo Zhang, H. Vincent Poor

According to our analysis, the UDP framework can realize $(\epsilon_{i}, \delta_{i})$-LDP for the $i$-th MT with adjustable privacy protection levels by varying the variances of the artificial noise processes.

Federated Learning Privacy Preserving

Federated Learning with Differential Privacy: Algorithms and Performance Analysis

no code implementations1 Nov 2019 Kang Wei, Jun Li, Ming Ding, Chuan Ma, Howard H. Yang, Farokhi Farhad, Shi Jin, Tony Q. S. Quek, H. Vincent Poor

Specifically, the theoretical bound reveals the following three key properties: 1) There is a tradeoff between the convergence performance and privacy protection levels, i. e., a better convergence performance leads to a lower protection level; 2) Given a fixed privacy protection level, increasing the number $N$ of overall clients participating in FL can improve the convergence performance; 3) There is an optimal number of maximum aggregation times (communication rounds) in terms of convergence performance for a given protection level.

Federated Learning Privacy Preserving

On Safeguarding Privacy and Security in the Framework of Federated Learning

no code implementations14 Sep 2019 Chuan Ma, Jun Li, Ming Ding, Howard Hao Yang, Feng Shu, Tony Q. S. Quek, H. Vincent Poor

Motivated by the advancing computational capacity of wireless end-user equipment (UE), as well as the increasing concerns about sharing private data, a new machine learning (ML) paradigm has emerged, namely federated learning (FL).

Networking and Internet Architecture

Towards Knowledge-Based Recommender Dialog System

2 code implementations IJCNLP 2019 Qibin Chen, Junyang Lin, Yichang Zhang, Ming Ding, Yukuo Cen, Hongxia Yang, Jie Tang

In this paper, we propose a novel end-to-end framework called KBRD, which stands for Knowledge-Based Recommender Dialog System.

Recommendation Systems

Privacy-Preserved Task Offloading in Mobile Blockchain with Deep Reinforcement Learning

no code implementations15 Aug 2019 Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding, Aruna Seneviratne

Blockchain technology with its secure, transparent and decentralized nature has been recently employed in many mobile applications.

Edge-computing reinforcement-learning

Secure Computation Offloading in Blockchain based IoT Networks with Deep Reinforcement Learning

no code implementations15 Aug 2019 Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding, Aruna Seneviratne

How to implement offloading to alleviate computation burdens at MDs while guaranteeing high security in mobile edge cloud is a challenging problem.

reinforcement-learning

Cognitive Knowledge Graph Reasoning for One-shot Relational Learning

1 code implementation13 Jun 2019 Zhengxiao Du, Chang Zhou, Ming Ding, Hongxia Yang, Jie Tang

Inferring new facts from existing knowledge graphs (KG) with explainable reasoning processes is a significant problem and has received much attention recently.

Knowledge Graphs Relational Reasoning

Privacy Preserving Location Data Publishing: A Machine Learning Approach

no code implementations24 Feb 2019 Sina Shaham, Ming Ding, Bo Liu, Shuping Dang, Zihuai Lin, Jun Li

By introducing a new formulation of the problem, we are able to apply machine learning algorithms for clustering the trajectories and propose to use $k$-means algorithm for this purpose.

Multiple Sequence Alignment Privacy Preserving

Semi-supervised Learning on Graphs with Generative Adversarial Nets

1 code implementation1 Sep 2018 Ming Ding, Jie Tang, Jie Zhang

We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel approach to semi-supervised learning on graphs.

Spectral Network Embedding: A Fast and Scalable Method via Sparsity

1 code implementation7 Jun 2018 Jie Zhang, Yan Wang, Jie Tang, Ming Ding

In this paper, we propose a $10\times \sim 100\times$ faster network embedding method, called Progle, by elegantly utilizing the sparsity property of online networks and spectral analysis.

Link Prediction Network Embedding +1

Privacy Preservation in Location-Based Services: A Novel Metric and Attack Model

no code implementations16 May 2018 Sina Shaham, Ming Ding, Bo Liu, Zihuai Lin, Jun Li

In this paper, we incorporate a new type of side information based on consecutive location changes of users and propose a new metric called transition-entropy to investigate the location privacy preservation, followed by two algorithms to improve the transition-entropy for a given dummy generation algorithm.

Cannot find the paper you are looking for? You can Submit a new open access paper.