Search Results for author: Jun Zhang

Found 260 papers, 84 papers with code

PrivBayes: Private Data release via Bayesian networks

no code implementations Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data 2014 Jun Zhang, Graham Cormode, Cecilia M. Procopiuc, Divesh Srivastava, Xiaokui Xiao

Given a dataset D, PRIVBAYES first constructs a Bayesian network N , which (i) provides a succinct model of the correlations among the attributes in D and (ii) allows us to approximate the distribution of data in D using a set P of lowdimensional marginals of D. After that, PRIVBAYES injects noise into each marginal in P to ensure differential privacy, and then uses the noisy marginals and the Bayesian network to construct an approximation of the data distribution in D. Finally, PRIVBAYES samples tuples from the approximate distribution to construct a synthetic dataset, and then releases the synthetic data.

Privacy Preserving

Real-Time Traffic Signal Control for Modern Roundabouts by Using Particle Swarm Optimization-Based Fuzzy Controller

no code implementations4 Aug 2014 Yue-Jiao Gong, Jun Zhang

This mechanism helps to instantly respond to the current traffic condition of the roundabout so as to improve real-timeness.

Performance Analysis on Evolutionary Algorithms for the Minimum Label Spanning Tree Problem

no code implementations3 Sep 2014 Xinsheng Lai, Yuren Zhou, Jun He, Jun Zhang

We also show that GSEMO achieves a $(2ln(n))$-approximation ratio for the MLST problem in expected polynomial time of $n$ and $k$.

Evolutionary Algorithms

Implementation of Training Convolutional Neural Networks

no code implementations3 Jun 2015 Tianyi Liu, Shuangsang Fang, Yuehui Zhao, Peng Wang, Jun Zhang

Deep learning refers to the shining branch of machine learning that is based on learning levels of representations.

BIG-bench Machine Learning Face Recognition

Agglomerative clustering and collectiveness measure via exponent generating function

no code implementations30 Jul 2015 Wei-Ya Ren, Shuo-Hao Li, Qiang Guo, Guo-Hui Li, Jun Zhang

A novel agglomerative clustering method is proposed by utilizing the path integral to define the affinity measure.

Clustering

Dynamic Computation Offloading for Mobile-Edge Computing with Energy Harvesting Devices

no code implementations18 May 2016 Yuyi Mao, Jun Zhang, Khaled B. Letaief

Sample simulation results shall be presented to verify the theoretical analysis as well as validate the effectiveness of the proposed algorithm.

Information Theory Information Theory

Power Data Classification: A Hybrid of a Novel Local Time Warping and LSTM

no code implementations15 Aug 2016 Yuanlong Li, Han Hu, Yonggang Wen, Jun Zhang

Finally, using the power consumption data from a real data center, we show that the proposed LTW can improve the classification accuracy of DTW from about 84% to 90%.

Classification General Classification +3

Vertical stratification of forest canopy for segmentation of under-story trees within small-footprint airborne LiDAR point clouds

no code implementations31 Dec 2016 Hamid Hamraz, Marco A. Contreras, Jun Zhang

This paper presents a tree segmentation approach for multi-story stands that stratifies the point cloud to canopy layers and segments individual tree crowns within each layer using a digital surface model based tree segmentation method.

Segmentation

A robust approach for tree segmentation in deciduous forests using small-footprint airborne LiDAR data

no code implementations1 Jan 2017 Hamid Hamraz, Marco A. Contreras, Jun Zhang

This paper presents a non-parametric approach for segmenting trees from airborne LiDAR data in deciduous forests.

Forest understory trees can be segmented accurately within sufficiently dense airborne laser scanning point clouds

no code implementations17 Feb 2017 Hamid Hamraz, Marco A. Contreras, Jun Zhang

Existing segmentation procedures typically detect more than 90% of overstory trees, yet they barely detect 60% of understory trees because of the occlusion effect of higher canopy layers.

Exponential Moving Average Model in Parallel Speech Recognition Training

no code implementations3 Mar 2017 Xu Tian, Jun Zhang, Zejun Ma, Yi He, Juan Wei

As training data rapid growth, large-scale parallel training with multi-GPUs cluster is widely applied in the neural network model learning currently. We present a new approach that applies exponential moving average method in large-scale parallel training of neural network model.

speech-recognition Speech Recognition

Deep LSTM for Large Vocabulary Continuous Speech Recognition

no code implementations21 Mar 2017 Xu Tian, Jun Zhang, Zejun Ma, Yi He, Juan Wei, Peihao Wu, Wenchang Situ, Shuai Li, Yang Zhang

It is a competitive framework that LSTM models of more than 7 layers are successfully trained on Shenma voice search data in Mandarin and they outperform the deep LSTM models trained by conventional approach.

speech-recognition Speech Recognition +1

Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detection

no code implementations20 Apr 2017 Tong Chen, Lin Wu, Xue Li, Jun Zhang, Hongzhi Yin, Yang Wang

The proposed model delves soft-attention into the recurrence to simultaneously pool out distinct features with particular focus and produce hidden representations that capture contextual variations of relevant posts over time.

Deep Attention

Frame Stacking and Retaining for Recurrent Neural Network Acoustic Model

no code implementations17 May 2017 Xu Tian, Jun Zhang, Zejun Ma, Yi He, Juan Wei

The system which combined frame retaining with frame stacking could reduces the time consumption of both training and decoding.

Decoder General Classification

When Point Process Meets RNNs: Predicting Fine-Grained User Interests with Mutual Behavioral Infectivity

no code implementations14 Oct 2017 Tong Chen, Lin Wu, Yang Wang, Jun Zhang, Hongxu Chen, Xue Li

Inspired by point process in modeling temporal point process, in this paper we present a deep prediction method based on two recurrent neural networks (RNNs) to jointly model each user's continuous browsing history and asynchronous event sequences in the context of inter-user behavioral mutual infectivity.

Deep learning analysis of breast MRIs for prediction of occult invasive disease in ductal carcinoma in situ

no code implementations28 Nov 2017 Zhe Zhu, Michael Harowicz, Jun Zhang, Ashirbani Saha, Lars J. Grimm, E. Shelley Hwang, Maciej A. Mazurowski

In the first approach, we adopted the transfer learning strategy, in which a network pre-trained on a large dataset of natural images is fine-tuned with our DCIS images.

Transfer Learning

Deep Learning for identifying radiogenomic associations in breast cancer

no code implementations29 Nov 2017 Zhe Zhu, Ehab AlBadawy, Ashirbani Saha, Jun Zhang, Michael R. Harowicz, Maciej A. Mazurowski

Results: The best AUC performance for distinguishing molecular subtypes was 0. 65 (95% CI:[0. 57, 0. 71]) and was achieved by the off-the-shelf deep features approach.

Transfer Learning

Deep Nearest Class Mean Model for Incremental Odor Classification

no code implementations8 Jan 2018 Yu Cheng, Angus Wong, Kevin Hung, Zhizhong Li, Weitong Li, Jun Zhang

That is, the odor datasets are dynamically growing while both training samples and number of classes are increasing over time.

Classification General Classification

Automated Big Traffic Analytics for Cyber Security

no code implementations24 Apr 2018 Yuantian Miao, Zichan Ruan, Lei Pan, Yu Wang, Jun Zhang, Yang Xiang

Network traffic analytics technology is a cornerstone for cyber security systems.

Cryptography and Security

Automatic deep learning-based normalization of breast dynamic contrast-enhanced magnetic resonance images

no code implementations5 Jul 2018 Jun Zhang, Ashirbani Saha, Brian J. Soher, Maciej A. Mazurowski

Then, based on the segmentation results, a subject-specific piecewise linear mapping function was applied between the anchor points to normalize the same type of tissue in different patients into the same intensity ranges.

Segmentation

Android HIV: A Study of Repackaging Malware for Evading Machine-Learning Detection

no code implementations10 Aug 2018 Xiao Chen, Chaoran Li, Derui Wang, Sheng Wen, Jun Zhang, Surya Nepal, Yang Xiang, Kui Ren

In contrast to existing works, the adversarial examples crafted by our method can also deceive recent machine learning based detectors that rely on semantic features such as control-flow-graph.

Cryptography and Security

Towards an Intelligent Edge: Wireless Communication Meets Machine Learning

no code implementations2 Sep 2018 Guangxu Zhu, Dongzhu Liu, Yuqing Du, Changsheng You, Jun Zhang, Kaibin Huang

Accordingly, a new research area, called edge learning, emerges, which crosses and revolutionizes two disciplines: wireless communication and machine learning.

BIG-bench Machine Learning Edge-computing

Inverse-Consistent Deep Networks for Unsupervised Deformable Image Registration

2 code implementations10 Sep 2018 Jun Zhang

Deformable image registration is a fundamental task in medical image analysis, aiming to establish a dense and non-linear correspondence between a pair of images.

Image Registration

Session-level Language Modeling for Conversational Speech

no code implementations EMNLP 2018 Wayne Xiong, Lingfeng Wu, Jun Zhang, Andreas Stolcke

We propose to generalize language models for conversational speech recognition to allow them to operate across utterance boundaries and speaker changes, thereby capturing conversation-level phenomena such as adjacency pairs, lexical entrainment, and topical coherence.

Language Modelling speech-recognition +1

Transfer Learning for Mixed-Integer Resource Allocation Problems in Wireless Networks

no code implementations17 Nov 2018 Yifei Shen, Yuanming Shi, Jun Zhang, Khaled B. Letaief

A unique advantage of the proposed method is that it can tackle the task mismatch issue with a few additional unlabeled training samples, which is especially important when transferring to large-size problems.

Transfer Learning

Wireless Data Acquisition for Edge Learning: Data-Importance Aware Retransmission

no code implementations5 Dec 2018 Dongzhu Liu, Guangxu Zhu, Jun Zhang, Kaibin Huang

To solve the problem, a new retransmission protocol called data-importance aware automatic-repeat-request (importance ARQ) is proposed.

LORM: Learning to Optimize for Resource Management in Wireless Networks with Few Training Samples

no code implementations18 Dec 2018 Yifei Shen, Yuanming Shi, Jun Zhang, Khaled B. Letaief

To further address the task mismatch problem, we develop a transfer learning method via self-imitation in LORM, named LORM-TL, which can quickly adapt a pre-trained machine learning model to the new task with only a few additional unlabeled training samples.

BIG-bench Machine Learning Imitation Learning +2

On Reproducing Kernel Banach Spaces: Generic Definitions and Unified Framework of Constructions

no code implementations4 Jan 2019 Rongrong Lin, Haizhang Zhang, Jun Zhang

We explore a generic definition of RKBS and the reproducing kernel for RKBS that is independent of construction.

BIG-bench Machine Learning

Hybrid Beamforming for Millimeter Wave Systems Using the MMSE Criterion

2 code implementations22 Feb 2019 Tian Lin, Jiaqi Cong, Yu Zhu, Jun Zhang, Khaled B. Letaief

A particular innovation in our proposed alternating minimization algorithms is a carefully designed initialization method, which leads to faster convergence.

Information Theory Information Theory

Topological Persistence in Geometry and Analysis

no code implementations8 Apr 2019 Leonid Polterovich, Daniel Rosen, Karina Samvelyan, Jun Zhang

The theory of persistence modules is an emerging field of algebraic topology which originated in topological data analysis.

Algebraic Topology Classical Analysis and ODEs Symplectic Geometry 55U99, 58Cxx, 53Dxx

The Roadmap to 6G -- AI Empowered Wireless Networks

no code implementations26 Apr 2019 Khaled B. Letaief, Wei Chen, Yuanming Shi, Jun Zhang, Ying-Jun Angela Zhang

The recent upsurge of diversified mobile applications, especially those supported by Artificial Intelligence (AI), is spurring heated discussions on the future evolution of wireless communications.

DeepIlluminance: Contextual Illuminance Estimation via Deep Neural Networks

1 code implementation12 May 2019 Jun Zhang, Tong Zheng, Shengping Zhang, Meng Wang

First, the contextual net with a center-surround architecture extracts local contextual features from image patches, and generates initial illuminant estimates and the corresponding color corrected patches.

Color Constancy

Client-Edge-Cloud Hierarchical Federated Learning

1 code implementation16 May 2019 Lumin Liu, Jun Zhang, S. H. Song, Khaled B. Letaief

To combine their advantages, we propose a client-edge-cloud hierarchical Federated Learning system, supported with a HierFAVG algorithm that allows multiple edge servers to perform partial model aggregation.

Federated Learning

Mobile Edge Intelligence and Computing for the Internet of Vehicles

no code implementations2 Jun 2019 Jun Zhang, Khaled B. Letaief

The Internet of Vehicles (IoV) is an emerging paradigm, driven by recent advancements in vehicular communications and networking.

Networking and Internet Architecture Signal Processing

Learning Clustered Representation for Complex Free Energy Landscapes

no code implementations7 Jun 2019 Jun Zhang, Yao-Kun Lei, Xing Che, Zhen Zhang, Yi Isaac Yang, Yi Qin Gao

In this paper we first analyzed the inductive bias underlying the data scattered across complex free energy landscapes (FEL), and exploited it to train deep neural networks which yield reduced and clustered representation for the FEL.

Clustering Dimensionality Reduction +1

Light Field Saliency Detection with Deep Convolutional Networks

2 code implementations19 Jun 2019 Jun Zhang, Yamei Liu, Shengping Zhang, Ronald Poppe, Meng Wang

Light field imaging presents an attractive alternative to RGB imaging because of the recording of the direction of the incoming light.

Benchmarking Saliency Detection

A Graph Neural Network Approach for Scalable Wireless Power Control

2 code implementations19 Jul 2019 Yifei Shen, Yuanming Shi, Jun Zhang, Khaled B. Letaief

Specifically, a $K$-user interference channel is first modeled as a complete graph, where the quantitative information of wireless channels is incorporated as the features of the graph.

Restricted Linearized Augmented Lagrangian Method for Euler's Elastica Model

no code implementations5 Aug 2019 Yinghui Zhang, Xiaojuan Deng, Jun Zhang, Hongwei Li

In this paper, a simple cutting-off strategy is introduced into the augmented Lagrangian based algorithms for minimizing the Euler's elastica energy, which leads to easy parameter tuning and fast convergence.

Constrained Pseudo-market Equilibrium

no code implementations12 Sep 2019 Federico Echenique, Antonio Miralles, Jun Zhang

We propose a pseudo-market solution to resource allocation problems subject to constraints.

Scheduling

Non-imaging single-pixel sensing with optimized binary modulation

no code implementations25 Sep 2019 Hao Fu, Liheng Bian, Jun Zhang

The conventional high-level sensing techniques require high-fidelity images as input to extract target features, which are produced by either complex imaging hardware or high-complexity reconstruction algorithms.

General Classification Image Classification

Multi-grained Attention Networks for Single Image Super-Resolution

no code implementations26 Sep 2019 Huapeng Wu, Zhengxia Zou, Jie Gui, Wen-Jun Zeng, Jieping Ye, Jun Zhang, Hongyi Liu, Zhihui Wei

In this paper, we make a thorough investigation on the attention mechanisms in a SR model and shed light on how simple and effective improvements on these ideas improve the state-of-the-arts.

Feature Importance Image Super-Resolution

BottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systems

1 code implementation31 Oct 2019 Jiawei Shao, Jun Zhang

By exploiting the strong sparsity and the fault-tolerant property of the intermediate feature in a deep neural network (DNN), BottleNet++ achieves a much higher compression ratio than existing methods.

Decoder Edge-computing +1

A Study of Data Pre-processing Techniques for Imbalanced Biomedical Data Classification

no code implementations4 Nov 2019 Shigang Liu, Jun Zhang, Yang Xiang, Wanlei Zhou, Dongxi Xiang

However, previous studies usually focused on different classifiers, and overlook the class imbalance problem in real-world biomedical datasets.

Drug Discovery feature selection +1

Ultra-Fast Accurate AoA Estimation via Automotive Massive-MIMO Radar

no code implementations18 Nov 2019 Bin Li, Shuseng Wang, Jun Zhang, Xainbin Cao, Chenglin Zhao

Massive multiple-input multiple-output (MIMO) radar, enabled by millimeter-wave virtual MIMO techniques, provides great promises to the high-resolution automotive sensing and target detection in unmanned ground/aerial vehicles (UGA/UAV).

Faster Activity and Data Detection in Massive Random Access: A Multi-armed Bandit Approach

no code implementations28 Jan 2020 Jialin Dong, Jun Zhang, Yuanming Shi, Jessie Hui Wang

In this paper, we develop multi-armed bandit approaches for more efficient detection via coordinate descent, which make a delicate trade-off between exploration and exploitation in coordinate selection.

Action Detection Activity Detection

Dynamic SLAM: The Need For Speed

1 code implementation20 Feb 2020 Mina Henein, Jun Zhang, Robert Mahony, Viorela Ila

In this paper, we propose a new feature-based, model-free, object-aware dynamic SLAM algorithm that exploits semantic segmentation to allow estimation of motion of rigid objects in a scene without the need to estimate the object poses or have any prior knowledge of their 3D models.

Robotics

Communication-Efficient Edge AI: Algorithms and Systems

no code implementations22 Feb 2020 Yuanming Shi, Kai Yang, Tao Jiang, Jun Zhang, Khaled B. Letaief

By pushing inference and training processes of AI models to edge nodes, edge AI has emerged as a promising alternative.

Drug Discovery Image Classification

DIHARD II is Still Hard: Experimental Results and Discussions from the DKU-LENOVO Team

no code implementations23 Feb 2020 Qingjian Lin, Weicheng Cai, Lin Yang, Jun-Jie Wang, Jun Zhang, Ming Li

Our diarization system includes multiple modules, namely voice activity detection (VAD), segmentation, speaker embedding extraction, similarity scoring, clustering, resegmentation and overlap detection.

Action Detection Activity Detection +1

Complete Dictionary Learning via $\ell_p$-norm Maximization

1 code implementation24 Feb 2020 Yifei Shen, Ye Xue, Jun Zhang, Khaled B. Letaief, Vincent Lau

Dictionary learning is a classic representation learning method that has been widely applied in signal processing and data analytics.

Computational Efficiency Dictionary Learning +1

Sparse Optimization for Green Edge AI Inference

no code implementations24 Feb 2020 Xiangyu Yang, Sheng Hua, Yuanming Shi, Hao Wang, Jun Zhang, Khaled B. Letaief

By exploiting the inherent connections between the set of task selection and group sparsity structural transmit beamforming vector, we reformulate the optimization as a group sparse beamforming problem.

Combinatorial Optimization Edge-computing

How many infections of COVID-19 there will be in the "Diamond Princess"-Predicted by a virus transmission model based on the simulation of crowd flow

1 code implementation25 Feb 2020 Zhiming Fang, Zhongyi Huang, Xiaolian Li, Jun Zhang, Wei Lv, Lei Zhuang, Xingpeng Xu, Nan Huang

Objectives: Simulate the transmission process of COVID-19 in a cruise ship, and then to judge how many infections there will be in the 3711 people in the "Diamond Princess" and analyze measures that could have prevented mass transmission.

Physics and Society Computers and Society

GATCluster: Self-Supervised Gaussian-Attention Network for Image Clustering

1 code implementation ECCV 2020 Chuang Niu, Jun Zhang, Ge Wang, Jimin Liang

To train the GATCluster in a completely unsupervised manner, we design four self-learning tasks with the constraints of transformation invariance, separability maximization, entropy analysis, and attention mapping.

Clustering Image Clustering +2

Scene Text Recognition via Transformer

no code implementations18 Mar 2020 Xinjie Feng, Hongxun Yao, Yuankai Qi, Jun Zhang, Shengping Zhang

Different from previous transformer based models [56, 34], which just use the decoder of the transformer to decode the convolutional attention, the proposed method use a convolutional feature maps as word embedding input into transformer.

Decoder Scene Text Recognition

Accelerating Physics-Informed Neural Network Training with Prior Dictionaries

1 code implementation17 Apr 2020 Wei Peng, Weien Zhou, Jun Zhang, Wen Yao

Physics-Informed Neural Networks (PINNs) can be regarded as general-purpose PDE solvers, but it might be slow to train PINNs on particular problems, and there is no theoretical guarantee of corresponding error bounds.

A Perspective on Deep Learning for Molecular Modeling and Simulations

no code implementations25 Apr 2020 Jun Zhang, Yao-Kun Lei, Zhen Zhang, Junhan Chang, Maodong Li, Xu Han, Lijiang Yang, Yi Isaac Yang, Yi Qin Gao

Deep learning is transforming many areas in science, and it has great potential in modeling molecular systems.

Blind Data Detection in Massive MIMO via $\ell_3$-norm Maximization over the Stiefel Manifold

no code implementations26 Apr 2020 Ye Xue, Yifei Shen, Vincent Lau, Jun Zhang, Khaled B. Letaief

Specifically, we propose a novel $\ell_3$-norm-based formulation to recover the data without channel estimation.

Target-based Sentiment Annotation in Chinese Financial News

no code implementations LREC 2020 Chaofa Yuan, Yu-Han Liu, Rongdi Yin, Jun Zhang, Qinling Zhu, Ruibin Mao, Ruifeng Xu

Based on high quality annotation guideline and effective quality control strategy, a corpus with 8, 314 target-level sentiment annotation is constructed on 6, 336 paragraphs from Chinese financial news text.

Sentiment Analysis

The Design and Construction of a Chinese Sarcasm Dataset

no code implementations LREC 2020 Xiaochang Gong, Qin Zhao, Jun Zhang, Ruibin Mao, Ruifeng Xu

Thus, the detection and processing of sarcasm is important to social media analysis. However, most existing sarcasm dataset are in English and there is still a lack of authoritative Chinese sarcasm dataset.

Efficient and fair trading algorithms in market design environments

no code implementations14 May 2020 Jingsheng Yu, Jun Zhang

We propose a new method to define trading algorithms in market design environments.

Fairness

Cores in discrete exchange economies with complex endowments

no code implementations19 May 2020 Jun Zhang

The core is a traditional and useful solution concept in economic theory.

Blocking

VDO-SLAM: A Visual Dynamic Object-aware SLAM System

1 code implementation22 May 2020 Jun Zhang, Mina Henein, Robert Mahony, Viorela Ila

Combining Simultaneous Localisation and Mapping (SLAM) estimation and dynamic scene modelling can highly benefit robot autonomy in dynamic environments.

Robotics

Communication-Computation Trade-Off in Resource-Constrained Edge Inference

1 code implementation3 Jun 2020 Jiawei Shao, Jun Zhang

The recent breakthrough in artificial intelligence (AI), especially deep neural networks (DNNs), has affected every branch of science and technology.

Edge-computing Model Compression

Deep Denoising Neural Network Assisted Compressive Channel Estimation for mmWave Intelligent Reflecting Surfaces

2 code implementations3 Jun 2020 Shicong Liu, Zhen Gao, Jun Zhang, Marco Di Renzo, Mohamed-Slim Alouini

Integrating large intelligent reflecting surfaces (IRS) into millimeter-wave (mmWave) massive multi-input-multi-ouput (MIMO) has been a promising approach for improved coverage and throughput.

Compressive Sensing Denoising

EPI-based Oriented Relation Networks for Light Field Depth Estimation

1 code implementation9 Jul 2020 Kunyuan Li, Jun Zhang, Rui Sun, Xu-Dong Zhang, Jun Gao

Based on the observation that an oriented line and its neighboring pixels in an EPI share a similar linear structure, we propose an end-to-end fully convolutional network (FCN) to estimate the depth value of the intersection point on the horizontal and vertical EPIs.

Data Augmentation Depth Estimation +1

Graph Neural Networks for Scalable Radio Resource Management: Architecture Design and Theoretical Analysis

1 code implementation15 Jul 2020 Yifei Shen, Yuanming Shi, Jun Zhang, Khaled B. Letaief

In this paper, we propose to apply graph neural networks (GNNs) to solve large-scale radio resource management problems, supported by effective neural network architecture design and theoretical analysis.

Computational Efficiency Distributed Optimization +1

Robust Ego and Object 6-DoF Motion Estimation and Tracking

2 code implementations28 Jul 2020 Jun Zhang, Mina Henein, Robert Mahony, Viorela Ila

The problem of tracking self-motion as well as motion of objects in the scene using information from a camera is known as multi-body visual odometry and is a challenging task.

Autonomous Driving Motion Estimation +2

Flow Field Reconstructions with GANs based on Radial Basis Functions

no code implementations11 Aug 2020 Liwei Hu, Wenyong Wang, Yu Xiang, Jun Zhang

Motivated by the problems of existing approaches and inspired by the success of the generative adversarial networks (GANs) in the field of computer vision, we prove an optimal discriminator theorem that the optimal discriminator of a GAN is a radial basis function neural network (RBFNN) while dealing with nonlinear sparse FFD regression and generation.

regression

Microscope Based HER2 Scoring System

no code implementations15 Sep 2020 Jun Zhang, Kuan Tian, Pei Dong, Haocheng Shen, Kezhou Yan, Jianhua Yao, Junzhou Huang, Xiao Han

Recently, artificial intelligence (AI) has been used in various disease diagnosis to improve diagnostic accuracy and reliability, but the interpretation of diagnosis results is still an open problem.

Group-Buying Recommendation for Social E-Commerce

1 code implementation14 Oct 2020 Jun Zhang, Chen Gao, Depeng Jin, Yong Li

Group-buying recommendation for social e-commerce, which recommends an item list when users want to launch a group, plays an important role in the group success ratio and sales.

From em-Projections to Variational Auto-Encoder

no code implementations NeurIPS Workshop DL-IG 2020 Tian Han, Jun Zhang, Ying Nian Wu

This paper reviews the em-projections in information geometry and the recent understanding of variational auto-encoder, and explains that they share a common formulation as joint minimization of the Kullback-Leibler divergence between two manifolds of probability distributions, and the joint minimization can be implemented by alternating projections or alternating gradient descent.

DeFuzz: Deep Learning Guided Directed Fuzzing

no code implementations23 Oct 2020 Xiaogang Zhu, Shigang Liu, Xian Li, Sheng Wen, Jun Zhang, Camtepe Seyit, Yang Xiang

Fuzzing is one of the most effective technique to identify potential software vulnerabilities.

Vulnerability Detection

Branchy-GNN: a Device-Edge Co-Inference Framework for Efficient Point Cloud Processing

1 code implementation27 Oct 2020 Jiawei Shao, Haowei Zhang, Yuyi Mao, Jun Zhang

The recent advancements of three-dimensional (3D) data acquisition devices have spurred a new breed of applications that rely on point cloud data processing.

Distributed, Parallel, and Cluster Computing

Improving RNN transducer with normalized jointer network

no code implementations3 Nov 2020 Mingkun Huang, Jun Zhang, Meng Cai, Yang Zhang, Jiali Yao, Yongbin You, Yi He, Zejun Ma

In this work, we analyze the cause of the huge gradient variance in RNN-T training and proposed a new \textit{normalized jointer network} to overcome it.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Dynamic latency speech recognition with asynchronous revision

no code implementations3 Nov 2020 Mingkun Huang, Meng Cai, Jun Zhang, Yang Zhang, Yongbin You, Yi He, Zejun Ma

In this work we propose an inference technique, asynchronous revision, to unify streaming and non-streaming speech recognition models.

Decoder speech-recognition +1

Deep Reinforcement Learning of Transition States

no code implementations13 Nov 2020 Jun Zhang, Yao-Kun Lei, Zhen Zhang, Xu Han, Maodong Li, Lijiang Yang, Yi Isaac Yang, Yi Qin Gao

Combining reinforcement learning (RL) and molecular dynamics (MD) simulations, we propose a machine-learning approach (RL$^\ddag$) to automatically unravel chemical reaction mechanisms.

reinforcement-learning Reinforcement Learning (RL)

Hawking radiation from nonrotating singularity-free black holes in conformal gravity

no code implementations2 Dec 2020 Jun Zhang, Yuan Sun

Besides, we investigate the dependence of the greybody factor and the sparsity of Hawking radiation on the conformal parameters.

General Relativity and Quantum Cosmology

Molecular CT: Unifying Geometry and Representation Learning for Molecules at Different Scales

no code implementations22 Dec 2020 Jun Zhang, Yao-Kun Lei, Yaqiang Zhou, Yi Isaac Yang, Yi Qin Gao

Deep learning is changing many areas in molecular physics, and it has shown great potential to deliver new solutions to challenging molecular modeling problems.

Computational Efficiency Representation Learning

Attentional Pyramid Pooling of Salient Visual Residuals for Place Recognition

no code implementations ICCV 2021 Guohao Peng, Jun Zhang, Heshan Li, Danwei Wang

The core of visual place recognition (VPR) lies in how to identify task-relevant visual cues and embed them into discriminative representations.

Visual Place Recognition

Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach

1 code implementation8 Feb 2021 Jiawei Shao, Yuyi Mao, Jun Zhang

Extensive experiments evidence that the proposed task-oriented communication system achieves a better rate-distortion tradeoff than baseline methods and significantly reduces the feature transmission latency in dynamic channel conditions.

Informativeness

Machine Learning Based Cyber Attacks Targeting on Controlled Information: A Survey

2 code implementations16 Feb 2021 Yuantian Miao, Chao Chen, Lei Pan, Qing-Long Han, Jun Zhang, Yang Xiang

Stealing attack against controlled information, along with the increasing number of information leakage incidents, has become an emerging cyber security threat in recent years.

BIG-bench Machine Learning

Supporting More Active Users for Massive Access via Data-assisted Activity Detection

no code implementations17 Feb 2021 Xinyu Bian, Yuyi Mao, Jun Zhang

Massive machine-type communication (mMTC) has been regarded as one of the most important use scenarios in the fifth generation (5G) and beyond wireless networks, which demands scalable access for a large number of devices.

Action Detection Activity Detection

Ask&Confirm: Active Detail Enriching for Cross-Modal Retrieval with Partial Query

1 code implementation ICCV 2021 Guanyu Cai, Jun Zhang, Xinyang Jiang, Yifei Gong, Lianghua He, Fufu Yu, Pai Peng, Xiaowei Guo, Feiyue Huang, Xing Sun

However, the performance of existing methods suffers in real life since the user is likely to provide an incomplete description of an image, which often leads to results filled with false positives that fit the incomplete description.

Cross-Modal Retrieval Image Retrieval +1

Single-photon imaging over 200 km

no code implementations10 Mar 2021 Zheng-Ping Li, Jun-Tian Ye, Xin Huang, Peng-Yu Jiang, Yuan Cao, Yu Hong, Chao Yu, Jun Zhang, Qiang Zhang, Cheng-Zhi Peng, Feihu Xu, Jian-Wei Pan

Long-range active imaging has widespread applications in remote sensing and target recognition.

A Deep Neural Network Surrogate Modeling Benchmark for Temperature Field Prediction of Heat Source Layout

1 code implementation20 Mar 2021 Xianqi Chen, Xiaoyu Zhao, Zhiqiang Gong, Jun Zhang, Weien Zhou, Xiaoqian Chen, Wen Yao

Thermal issue is of great importance during layout design of heat source components in systems engineering, especially for high functional-density products.

Layout Design Model Selection +1

Hierarchical Federated Learning with Quantization: Convergence Analysis and System Design

no code implementations26 Mar 2021 Lumin Liu, Jun Zhang, Shenghui Song, Khaled B. Letaief

Hierarchical FL, with a client-edge-cloud aggregation hierarchy, can effectively leverage both the cloud server's access to many clients' data and the edge servers' closeness to the clients to achieve a high communication efficiency.

Federated Learning Quantization

HMM-Free Encoder Pre-Training for Streaming RNN Transducer

no code implementations2 Apr 2021 Lu Huang, Jingyu Sun, Yufeng Tang, JunFeng Hou, Jinkun Chen, Jun Zhang, Zejun Ma

This work describes an encoder pre-training procedure using frame-wise label to improve the training of streaming recurrent neural network transducer (RNN-T) model.

Speech Recognition

Decentralized Statistical Inference with Unrolled Graph Neural Networks

1 code implementation4 Apr 2021 He Wang, Yifei Shen, Ziyuan Wang, Dongsheng Li, Jun Zhang, Khaled B. Letaief, Jie Lu

In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination.

Large-scale phase retrieval

no code implementations6 Apr 2021 Xuyang Chang, Liheng Bian, Jun Zhang

In computational phase imaging, phase retrieval (PR) is required to reconstruct both amplitude and phase in complex space from intensity-only measurements.

8k Retrieval

Affine-modeled video extraction from a single motion blurred image

no code implementations8 Apr 2021 Daoyu Li, Liheng Bian, Jun Zhang

Recovering these sharp video frames from a single blurred image is nontrivial, due to not only its strong ill-posedness, but also various types of complex motion in reality such as rotation and motion in depth.

Retrieval

Communication-Efficient Federated Learning with Dual-Side Low-Rank Compression

no code implementations26 Apr 2021 Zhefeng Qiao, Xianghao Yu, Jun Zhang, Khaled B. Letaief

Federated learning (FL) is a promising and powerful approach for training deep learning models without sharing the raw data of clients.

Federated Learning Low-rank compression

Joint Activity Detection and Data Decoding in Massive Random Access via a Turbo Receiver

no code implementations26 Apr 2021 Xinyu Bian, Yuyi Mao, Jun Zhang

In this paper, we propose a turbo receiver for joint activity detection and data decoding in grant-free massive random access, which iterates between a detector and a belief propagation (BP)-based channel decoder.

Action Detection Activity Detection +1

Semi-Decentralized Federated Edge Learning for Fast Convergence on Non-IID Data

no code implementations26 Apr 2021 Yuchang Sun, Jiawei Shao, Yuyi Mao, Jessie Hui Wang, Jun Zhang

Federated edge learning (FEEL) has emerged as an effective approach to reduce the large communication latency in Cloud-based machine learning solutions, while preserving data privacy.

Federated Learning

Privacy Inference Attacks and Defenses in Cloud-based Deep Neural Network: A Survey

no code implementations13 May 2021 XiaoYu Zhang, Chao Chen, Yi Xie, Xiaofeng Chen, Jun Zhang, Yang Xiang

This survey presents the most recent findings of privacy attacks and defenses appeared in cloud-based neural network services.

Cloud Computing

A Comprehensive Survey and Taxonomy on Single Image Dehazing Based on Deep Learning

1 code implementation7 Jun 2021 Jie Gui, Xiaofeng Cong, Yuan Cao, Wenqi Ren, Jun Zhang, Jing Zhang, Jiuxin Cao, DaCheng Tao

With the development of convolutional neural networks, hundreds of deep learning based dehazing methods have been proposed.

Image Dehazing Single Image Dehazing

Agile wide-field imaging with selective high resolution

no code implementations9 Jun 2021 Lintao Peng, Liheng Bian, Tiexin Liu, Jun Zhang

In this work, we report an agile wide-field imaging framework with selective high resolution that requires only two detectors.

Vocal Bursts Intensity Prediction

Invariant Information Bottleneck for Domain Generalization

no code implementations11 Jun 2021 Bo Li, Yifei Shen, Yezhen Wang, Wenzhen Zhu, Colorado J. Reed, Jun Zhang, Dongsheng Li, Kurt Keutzer, Han Zhao

IIB significantly outperforms IRM on synthetic datasets, where the pseudo-invariant features and geometric skews occur, showing the effectiveness of proposed formulation in overcoming failure modes of IRM.

Domain Generalization

Feedback Pyramid Attention Networks for Single Image Super-Resolution

no code implementations13 Jun 2021 Huapeng Wu, Jie Gui, Jun Zhang, James T. Kwok, Zhihui Wei

Recently, convolutional neural network (CNN) based image super-resolution (SR) methods have achieved significant performance improvement.

Image Super-Resolution

Pyramidal Dense Attention Networks for Lightweight Image Super-Resolution

no code implementations13 Jun 2021 Huapeng Wu, Jie Gui, Jun Zhang, James T. Kwok, Zhihui Wei

Recently, deep convolutional neural network methods have achieved an excellent performance in image superresolution (SR), but they can not be easily applied to embedded devices due to large memory cost.

Image Super-Resolution

Learning 3D Shape Feature for Texture-Insensitive Person Re-Identification

1 code implementation CVPR 2021 Jiaxing Chen, Xinyang Jiang, Fudong Wang, Jun Zhang, Feng Zheng, Xing Sun, Wei-Shi Zheng

In this paper, rather than relying on texture based information, we propose to improve the robustness of person ReID against clothing texture by exploiting the information of a person's 3D shape.

3D Reconstruction Person Re-Identification

Joint Deep Reversible Regression Model and Physics-Informed Unsupervised Learning for Temperature Field Reconstruction

1 code implementation22 Jun 2021 Zhiqiang Gong, Weien Zhou, Jun Zhang, Wei Peng, Wen Yao

To solve this problem, this work develops a novel physics-informed deep reversible regression models for temperature field reconstruction of heat-source systems (TFR-HSS), which can better reconstruct the temperature field with limited monitoring points unsupervisedly.

regression

IDRLnet: A Physics-Informed Neural Network Library

1 code implementation9 Jul 2021 Wei Peng, Jun Zhang, Weien Zhou, Xiaoyu Zhao, Wen Yao, Xiaoqian Chen

Physics Informed Neural Network (PINN) is a scientific computing framework used to solve both forward and inverse problems modeled by Partial Differential Equations (PDEs).

Joint Activity Detection, Channel Estimation, and Data Decoding for Grant-free Massive Random Access

no code implementations12 Jul 2021 Xinyu Bian, Yuyi Mao, Jun Zhang

In particular, the common sparsity pattern in the received pilot and data signal has been ignored in most existing studies, and auxiliary information of channel decoding has not been utilized for user activity detection.

Action Detection Activity Detection +1

RBUE: A ReLU-Based Uncertainty Estimation Method of Deep Neural Networks

no code implementations15 Jul 2021 Yufeng Xia, Jun Zhang, Zhiqiang Gong, Tingsong Jiang, Wen Yao

Deep Ensemble is widely considered the state-of-the-art method which can estimate the uncertainty with higher quality, but it is very expensive to train and test.

Deep Adaptive Arbitrary Polynomial Chaos Expansion: A Mini-data-driven Semi-supervised Method for Uncertainty Quantification

1 code implementation22 Jul 2021 Wen Yao, Xiaohu Zheng, Jun Zhang, Ning Wang, Guijian Tang

Based on the adaptive aPC, a semi-supervised deep adaptive arbitrary polynomial chaos expansion (Deep aPCE) method is proposed to reduce the training data cost and improve the surrogate model accuracy.

Dimensionality Reduction Uncertainty Quantification

Primary-Auxiliary Model Scheduling Based Estimation of the Vertical Wheel Force in a Full Vehicle System

no code implementations24 Jul 2021 Xueke Zheng, Runze Cai, Shuixin Xiao, Yu Qiu, Jun Zhang, Mian Li

A real-world application to the estimation of the vertical wheel force in a full vehicle system are, respectively, conducted to demonstrate the effectiveness of the proposed method.

Management Scheduling

Neural Calibration for Scalable Beamforming in FDD Massive MIMO with Implicit Channel Estimation

no code implementations3 Aug 2021 Yifan Ma, Yifei Shen, Xianghao Yu, Jun Zhang, S. H. Song, Khaled B. Letaief

Channel estimation and beamforming play critical roles in frequency-division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems.

How Powerful is Graph Convolution for Recommendation?

1 code implementation17 Aug 2021 Yifei Shen, Yongji Wu, Yao Zhang, Caihua Shan, Jun Zhang, Khaled B. Letaief, Dongsheng Li

In this paper, we endeavor to obtain a better understanding of GCN-based CF methods via the lens of graph signal processing.

Collaborative Filtering

Semantic Reinforced Attention Learning for Visual Place Recognition

no code implementations19 Aug 2021 Guohao Peng, Yufeng Yue, Jun Zhang, Zhenyu Wu, Xiaoyu Tang, Danwei Wang

(2) By exploiting the interpretability of the local weighting scheme, a semantic constrained initialization is proposed so that the local attention can be reinforced by semantic priors.

Visual Place Recognition

Image-free single-pixel segmentation

no code implementations24 Aug 2021 Haiyan Liu, Liheng Bian, Jun Zhang

We envision that this image-free segmentation technique can be widely applied in various resource-limited platforms such as UAV and unmanned vehicle that require real-time sensing.

Segmentation Semantic Segmentation

$k$Folden: $k$-Fold Ensemble for Out-Of-Distribution Detection

1 code implementation29 Aug 2021 Xiaoya Li, Jiwei Li, Xiaofei Sun, Chun Fan, Tianwei Zhang, Fei Wu, Yuxian Meng, Jun Zhang

For a task with $k$ training labels, $k$Folden induces $k$ sub-models, each of which is trained on a subset with $k-1$ categories with the left category masked unknown to the sub-model.

Attribute domain classification +4

Communication-Computation Efficient Device-Edge Co-Inference via AutoML

no code implementations30 Aug 2021 Xinjie Zhang, Jiawei Shao, Yuyi Mao, Jun Zhang

Device-edge co-inference, which partitions a deep neural network between a resource-constrained mobile device and an edge server, recently emerges as a promising paradigm to support intelligent mobile applications.

AutoML Decoder +2

Task-Oriented Communication for Multi-Device Cooperative Edge Inference

2 code implementations1 Sep 2021 Jiawei Shao, Yuyi Mao, Jun Zhang

To enable low-latency cooperative inference, we propose a learning-based communication scheme that optimizes local feature extraction and distributed feature encoding in a task-oriented manner, i. e., to remove data redundancy and transmit information that is essential for the downstream inference task rather than reconstructing the data samples at the edge server.

Sk-Unet Model with Fourier Domain for Mitosis Detection

no code implementations1 Sep 2021 Sen yang, Feng Luo, Jun Zhang, Xiyue Wang

Mitotic count is the most important morphological feature of breast cancer grading.

Mitosis Detection Segmentation

Learn to Communicate with Neural Calibration: Scalability and Generalization

no code implementations1 Oct 2021 Yifan Ma, Yifei Shen, Xianghao Yu, Jun Zhang, S. H. Song, Khaled B. Letaief

Furthermore, such networks will vary dynamically in a significant way, which makes it intractable to develop comprehensive analytical models.

Computational Efficiency Management

Asynchronous Semi-Decentralized Federated Edge Learning for Heterogeneous Clients

no code implementations9 Dec 2021 Yuchang Sun, Jiawei Shao, Yuyi Mao, Jun Zhang

Federated edge learning (FEEL) has drawn much attention as a privacy-preserving distributed learning framework for mobile edge networks.

Privacy Preserving

Semi-Decentralized Federated Edge Learning with Data and Device Heterogeneity

no code implementations20 Dec 2021 Yuchang Sun, Jiawei Shao, Yuyi Mao, Jessie Hui Wang, Jun Zhang

By exploiting the low-latency communication among edge servers for efficient model sharing, SD-FEEL can incorporate more training data, while enjoying much lower latency compared with conventional federated learning.

Federated Learning Privacy Preserving

Node-Aligned Graph Convolutional Network for Whole-Slide Image Representation and Classification

1 code implementation CVPR 2022 Yonghang Guan, Jun Zhang, Kuan Tian, Sen yang, Pei Dong, Jinxi Xiang, Wei Yang, Junzhou Huang, Yuyao Zhang, Xiao Han

In this paper, we propose a hierarchical global-to-local clustering strategy to build a Node-Aligned GCN (NAGCN) to represent WSI with rich local structural information as well as global distribution.

Clustering graph construction +2

Weighted Encoding Optimization for Dynamic Single-pixel Imaging and Sensing

no code implementations8 Jan 2022 Xinrui Zhan, Liheng Bian, Chunli Zhu, Jun Zhang

While the network is training at a high sampling rate, the modulation patterns and corresponding weights are updated iteratively, which produces optimal ranked encoding series when converged.

A Critical Analysis of Image-based Camera Pose Estimation Techniques

no code implementations15 Jan 2022 Meng Xu, Youchen Wang, Bin Xu, Jun Zhang, Jian Ren, Stefan Poslad, Pengfei Xu

Camera, and associated with its objects within the field of view, localization could benefit many computer vision fields, such as autonomous driving, robot navigation, and augmented reality (AR).

Autonomous Driving Camera Localization +3

Data-Driven Deep Learning Based Hybrid Beamforming for Aerial Massive MIMO-OFDM Systems with Implicit CSI

no code implementations18 Jan 2022 Zhen Gao, Minghui Wu, Chun Hu, Feifei Gao, Guanghui Wen, Dezhi Zheng, Jun Zhang

To this end, by modeling the key transmission modules as an end-to-end (E2E) neural network, this paper proposes a data-driven deep learning (DL)-based unified hybrid beamforming framework for both the time division duplex (TDD) and frequency division duplex (FDD) systems with implicit channel state information (CSI).

Quantization Transfer Learning

Stochastic Coded Federated Learning with Convergence and Privacy Guarantees

no code implementations25 Jan 2022 Yuchang Sun, Jiawei Shao, Songze Li, Yuyi Mao, Jun Zhang

Federated learning (FL) has attracted much attention as a privacy-preserving distributed machine learning framework, where many clients collaboratively train a machine learning model by exchanging model updates with a parameter server instead of sharing their raw data.

Federated Learning Privacy Preserving

The Gene of Scientific Success

no code implementations17 Feb 2022 Xiangjie Kong, Jun Zhang, Da Zhang, Yi Bu, Ying Ding, Feng Xia

Under this consideration, our paper presents and analyzes the causal factors that are crucial for scholars' academic success.

AugHover-Net: Augmenting Hover-net for Nucleus Segmentation and Classification

no code implementations4 Mar 2022 Wenhua Zhang, Jun Zhang

Connective nuclei may look very different from each other while some of them share a similar shape with the epithelial ones.

Classification Segmentation

Communication-Efficient Federated Distillation with Active Data Sampling

no code implementations14 Mar 2022 Lumin Liu, Jun Zhang, S. H. Song, Khaled B. Letaief

Federated Distillation (FD) is a recently proposed alternative to enable communication-efficient and robust FL, which achieves orders of magnitude reduction of the communication overhead compared with FedAvg and is flexible to handle heterogeneous models at the clients.

Federated Learning Privacy Preserving +1

Graph Neural Networks for Wireless Communications: From Theory to Practice

1 code implementation21 Mar 2022 Yifei Shen, Jun Zhang, S. H. Song, Khaled B. Letaief

For design guidelines, we propose a unified framework that is applicable to general design problems in wireless networks, which includes graph modeling, neural architecture design, and theory-guided performance enhancement.

Making DeepFakes more spurious: evading deep face forgery detection via trace removal attack

no code implementations22 Mar 2022 Chi Liu, Huajie Chen, Tianqing Zhu, Jun Zhang, Wanlei Zhou

To evaluate the attack efficacy, we crafted heterogeneous security scenarios where the detectors were embedded with different levels of defense and the attackers' background knowledge of data varies.

Face Swapping

Deep learning-based approach to reveal tumor mutational burden status from whole slide images across multiple cancer types

no code implementations7 Apr 2022 Siteng Chen, Jinxi Xiang, Xiyue Wang, Jun Zhang, Sen yang, Junzhou Huang, Wei Yang, Junhua Zheng, Xiao Han

MC-TMB algorithm also exhibited good generalization on the external validation cohort with an AUC of 0. 732 (0. 683-0. 761), and better performance when compared to other methods.

whole slide images

Hybrid Far- and Near-Field Channel Estimation for THz Ultra-Massive MIMO via Fixed Point Networks

1 code implementation10 May 2022 Wentao Yu, Yifei Shen, Hengtao He, Xianghao Yu, Jun Zhang, Khaled B. Letaief

We draw inspirations from fixed point theory to develop an efficient deep learning based channel estimator with adaptive complexity and linear convergence guarantee.

Evolution as a Service: A Privacy-Preserving Genetic Algorithm for Combinatorial Optimization

no code implementations27 May 2022 Bowen Zhao, Wei-neng Chen, Feng-Feng Wei, Ximeng Liu, Qingqi Pei, Jun Zhang

Specifically, PEGA enables users outsourcing COPs to the cloud server holding a competitive GA and approximating the optimal solution in a privacy-preserving manner.

Combinatorial Optimization Evolutionary Algorithms +2

Sparse Mixture-of-Experts are Domain Generalizable Learners

1 code implementation8 Jun 2022 Bo Li, Yifei Shen, Jingkang Yang, Yezhen Wang, Jiawei Ren, Tong Che, Jun Zhang, Ziwei Liu

It is motivated by an empirical finding that transformer-based models trained with empirical risk minimization (ERM) outperform CNN-based models employing state-of-the-art (SOTA) DG algorithms on multiple DG datasets.

Ranked #11 on Domain Generalization on DomainNet (using extra training data)

Domain Generalization Object Recognition

Federated Learning with GAN-based Data Synthesis for Non-IID Clients

no code implementations11 Jun 2022 Zijian Li, Jiawei Shao, Yuyi Mao, Jessie Hui Wang, Jun Zhang

A combination of the local private dataset and synthetic dataset with confident pseudo labels leads to nearly identical data distributions among clients, which improves the consistency among local models and benefits the global aggregation.

Federated Learning Generative Adversarial Network +1

Resource-Constrained Edge AI with Early Exit Prediction

no code implementations15 Jun 2022 Rongkang Dong, Yuyi Mao, Jun Zhang

In this paper, we propose an early exit prediction mechanism to reduce the on-device computation overhead in a device-edge co-inference system supported by early-exit networks.

A Manifold-based Airfoil Geometric-feature Extraction and Discrepant Data Fusion Learning Method

no code implementations23 Jun 2022 Yu Xiang, Guangbo Zhang, Liwei Hu, Jun Zhang, Wenyong Wang

Geometrical shape of airfoils, together with the corresponding flight conditions, are crucial factors for aerodynamic performances prediction.

Multi-Task Learning

Unsupervisedly Prompting AlphaFold2 for Few-Shot Learning of Accurate Folding Landscape and Protein Structure Prediction

2 code implementations20 Aug 2022 Jun Zhang, Sirui Liu, Mengyun Chen, Haotian Chu, Min Wang, Zidong Wang, Jialiang Yu, Ningxi Ni, Fan Yu, Diqing Chen, Yi Isaac Yang, Boxin Xue, Lijiang Yang, YuAn Liu, Yi Qin Gao

Data-driven predictive methods which can efficiently and accurately transform protein sequences into biologically active structures are highly valuable for scientific research and medical development.

Denoising Few-Shot Learning +2

Augmented Deep Unfolding for Downlink Beamforming in Multi-cell Massive MIMO With Limited Feedback

no code implementations3 Sep 2022 Yifan Ma, Xianghao Yu, Jun Zhang, S. H. Song, Khaled B. Letaief

In limited feedback multi-user multiple-input multiple-output (MU-MIMO) cellular networks, users send quantized information about the channel conditions to the associated base station (BS) for downlink beamforming.

Quantization

DeepNoise: Signal and Noise Disentanglement based on Classifying Fluorescent Microscopy Images via Deep Learning

1 code implementation13 Sep 2022 Sen yang, Tao Shen, Yuqi Fang, Xiyue Wang, Jun Zhang, Wei Yang, Junzhou Huang, Xiao Han

The high-content image-based assay is commonly leveraged for identifying the phenotypic impact of genetic perturbations in biology field.

Disentanglement Drug Discovery +1

Multi-dataset Training of Transformers for Robust Action Recognition

1 code implementation26 Sep 2022 Junwei Liang, Enwei Zhang, Jun Zhang, Chunhua Shen

We study the task of robust feature representations, aiming to generalize well on multiple datasets for action recognition.

Action Recognition Temporal Action Localization

Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrieval

no code implementations27 Sep 2022 Chengzhi Lin, AnCong Wu, Junwei Liang, Jun Zhang, Wenhang Ge, Wei-Shi Zheng, Chunhua Shen

To address this problem, we propose a Text-Adaptive Multiple Visual Prototype Matching model, which automatically captures multiple prototypes to describe a video by adaptive aggregation of video token features.

Cross-Modal Retrieval Retrieval +2

SoccerNet 2022 Challenges Results

7 code implementations5 Oct 2022 Silvio Giancola, Anthony Cioppa, Adrien Deliège, Floriane Magera, Vladimir Somers, Le Kang, Xin Zhou, Olivier Barnich, Christophe De Vleeschouwer, Alexandre Alahi, Bernard Ghanem, Marc Van Droogenbroeck, Abdulrahman Darwish, Adrien Maglo, Albert Clapés, Andreas Luyts, Andrei Boiarov, Artur Xarles, Astrid Orcesi, Avijit Shah, Baoyu Fan, Bharath Comandur, Chen Chen, Chen Zhang, Chen Zhao, Chengzhi Lin, Cheuk-Yiu Chan, Chun Chuen Hui, Dengjie Li, Fan Yang, Fan Liang, Fang Da, Feng Yan, Fufu Yu, Guanshuo Wang, H. Anthony Chan, He Zhu, Hongwei Kan, Jiaming Chu, Jianming Hu, Jianyang Gu, Jin Chen, João V. B. Soares, Jonas Theiner, Jorge De Corte, José Henrique Brito, Jun Zhang, Junjie Li, Junwei Liang, Leqi Shen, Lin Ma, Lingchi Chen, Miguel Santos Marques, Mike Azatov, Nikita Kasatkin, Ning Wang, Qiong Jia, Quoc Cuong Pham, Ralph Ewerth, Ran Song, RenGang Li, Rikke Gade, Ruben Debien, Runze Zhang, Sangrok Lee, Sergio Escalera, Shan Jiang, Shigeyuki Odashima, Shimin Chen, Shoichi Masui, Shouhong Ding, Sin-wai Chan, Siyu Chen, Tallal El-Shabrawy, Tao He, Thomas B. Moeslund, Wan-Chi Siu, Wei zhang, Wei Li, Xiangwei Wang, Xiao Tan, Xiaochuan Li, Xiaolin Wei, Xiaoqing Ye, Xing Liu, Xinying Wang, Yandong Guo, YaQian Zhao, Yi Yu, YingYing Li, Yue He, Yujie Zhong, Zhenhua Guo, Zhiheng Li

The SoccerNet 2022 challenges were the second annual video understanding challenges organized by the SoccerNet team.

Action Spotting Camera Calibration +3

DReS-FL: Dropout-Resilient Secure Federated Learning for Non-IID Clients via Secret Data Sharing

no code implementations6 Oct 2022 Jiawei Shao, Yuchang Sun, Songze Li, Jun Zhang

Federated learning (FL) strives to enable collaborative training of machine learning models without centrally collecting clients' private data.

Federated Learning

PARAGEN : A Parallel Generation Toolkit

1 code implementation7 Oct 2022 Jiangtao Feng, Yi Zhou, Jun Zhang, Xian Qian, Liwei Wu, Zhexi Zhang, Yanming Liu, Mingxuan Wang, Lei LI, Hao Zhou

PARAGEN is a PyTorch-based NLP toolkit for further development on parallel generation.

Model Selection

CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling

1 code implementation14 Oct 2022 Jun Zhang, Shuyang Jiang, Jiangtao Feng, Lin Zheng, Lingpeng Kong

In this paper, we propose Comprehensive Attention Benchmark (CAB) under a fine-grained attention taxonomy with four distinguishable attention patterns, namely, noncausal self, causal self, noncausal cross, and causal cross attentions.

Benchmarking Long-range modeling

Deep Latent Mixture Model for Recommendation

no code implementations27 Oct 2022 Jun Zhang, Ping Li, Wei Wang

Recent advances in neural networks have been successfully applied to many tasks in online recommendation applications.

Stochastic Coded Federated Learning: Theoretical Analysis and Incentive Mechanism Design

no code implementations8 Nov 2022 Yuchang Sun, Jiawei Shao, Yuyi Mao, Songze Li, Jun Zhang

During training, the server computes gradients on the global coded dataset to compensate for the missing model updates of the straggling devices.

Federated Learning Privacy Preserving

Blind Performance Prediction for Deep Learning Based Ultra-Massive MIMO Channel Estimation

no code implementations15 Nov 2022 Wentao Yu, Hengtao He, Xianghao Yu, Shenghui Song, Jun Zhang, Khaled B. Letaief

Reliability is of paramount importance for the physical layer of wireless systems due to its decisive impact on end-to-end performance.

Task-Oriented Communication for Edge Video Analytics

1 code implementation25 Nov 2022 Jiawei Shao, Xinjie Zhang, Jun Zhang

With the development of artificial intelligence (AI) techniques and the increasing popularity of camera-equipped devices, many edge video analytics applications are emerging, calling for the deployment of computation-intensive AI models at the network edge.

Informativeness

Lightweight and Flexible Deep Equilibrium Learning for CSI Feedback in FDD Massive MIMO

no code implementations28 Nov 2022 Yifan Ma, Wentao Yu, Xianghao Yu, Jun Zhang, Shenghui Song, Khaled B. Letaief

In this paper, we propose a lightweight and flexible deep learning-based CSI feedback approach by capitalizing on deep equilibrium models.

An Adaptive and Robust Deep Learning Framework for THz Ultra-Massive MIMO Channel Estimation

1 code implementation29 Nov 2022 Wentao Yu, Yifei Shen, Hengtao He, Xianghao Yu, Shenghui Song, Jun Zhang, Khaled B. Letaief

For practical usage, the proposed framework is further extended to wideband THz UM-MIMO systems with beam squint effect.

iEnhancer-ELM: improve enhancer identification by extracting position-related multiscale contextual information based on enhancer language models

1 code implementation3 Dec 2022 Jiahao Li, Zhourun Wu, Wenhao Lin, Jiawei Luo, Jun Zhang, Qingcai Chen, Junjie Chen

Although many feature extraction methods have been proposed to improve the performance of enhancer identification, they cannot learn position-related multiscale contextual information from raw DNA sequences.

Language Modelling Position

RLogist: Fast Observation Strategy on Whole-slide Images with Deep Reinforcement Learning

1 code implementation4 Dec 2022 Boxuan Zhao, Jun Zhang, Deheng Ye, Jian Cao, Xiao Han, Qiang Fu, Wei Yang

Most of the existing methods rely on a multiple instance learning framework that requires densely sampling local patches at high magnification.

Benchmarking Decision Making +4

Scattering-induced entropy boost for highly-compressed optical sensing and encryption

no code implementations16 Dec 2022 Liheng Bian, Xinrui Zhan, Xuyang Chang, Daoyu Li, Rong Yan, Yinuo Zhang, Haowen Ruan, Jun Zhang

In the proposed framework of single-pixel detection, the optical field from a target is first scattered by an optical diffuser and then two-dimensionally modulated by a spatial light modulator.

Image Classification

Large-scale single-photon imaging

no code implementations28 Dec 2022 Liheng Bian, Haoze Song, Lintao Peng, Xuyang Chang, Xi Yang, Roarke Horstmeyer, Lin Ye, Tong Qin, Dezhi Zheng, Jun Zhang

Benefiting from its single-photon sensitivity, single-photon avalanche diode (SPAD) array has been widely applied in various fields such as fluorescence lifetime imaging and quantum computing.

Super-Resolution

Machine Learning for Large-Scale Optimization in 6G Wireless Networks

no code implementations3 Jan 2023 Yandong Shi, Lixiang Lian, Yuanming Shi, Zixin Wang, Yong Zhou, Liqun Fu, Lin Bai, Jun Zhang, Wei zhang

The sixth generation (6G) wireless systems are envisioned to enable the paradigm shift from "connected things" to "connected intelligence", featured by ultra high density, large-scale, dynamic heterogeneity, diversified functional requirements and machine learning capabilities, which leads to a growing need for highly efficient intelligent algorithms.

Computational Efficiency Distributed Optimization +2

Artificial intelligence for diagnosing and predicting survival of patients with renal cell carcinoma: Retrospective multi-center study

no code implementations12 Jan 2023 Siteng Chen, Xiyue Wang, Jun Zhang, Liren Jiang, Ning Zhang, Feng Gao, Wei Yang, Jinxi Xiang, Sen yang, Junhua Zheng, Xiao Han

The OSrisk for the prediction of 5-year survival status achieved AUC of 0. 784 (0. 746-0. 819) in the TCGA cohort, which was further verified in the independent General cohort and the CPTAC cohort, with AUC of 0. 774 (0. 723-0. 820) and 0. 702 (0. 632-0. 765), respectively.

whole slide images

LDMIC: Learning-based Distributed Multi-view Image Coding

1 code implementation24 Jan 2023 Xinjie Zhang, Jiawei Shao, Jun Zhang

Multi-view image compression plays a critical role in 3D-related applications.

Data Compression Decoder +1

In-Context Learning with Many Demonstration Examples

1 code implementation9 Feb 2023 Mukai Li, Shansan Gong, Jiangtao Feng, Yiheng Xu, Jun Zhang, Zhiyong Wu, Lingpeng Kong

Based on EVALM, we scale up the size of examples efficiently in both instruction tuning and in-context learning to explore the boundary of the benefits from more annotated data.

16k 8k +2

Federated attention consistent learning models for prostate cancer diagnosis and Gleason grading

no code implementations13 Feb 2023 Fei Kong, Xiyue Wang, Jinxi Xiang, Sen yang, Xinran Wang, Meng Yue, Jun Zhang, Junhan Zhao, Xiao Han, Yuhan Dong, Biyue Zhu, Fang Wang, Yueping Liu

We assessed the effectiveness of FACL in cancer diagnosis and Gleason grading tasks using 19, 461 whole-slide images of prostate cancer from multiple centers.

Contrastive Learning Ethics +2

Hyperspectral Image Super Resolution with Real Unaligned RGB Guidance

1 code implementation13 Feb 2023 Zeqiang Lai, Ying Fu, Jun Zhang

The features of RGB reference images are then processed by a multi-stage alignment module to explicitly align the features of RGB reference with the LR HSI.

Hyperspectral Image Super-Resolution Image Super-Resolution

Message Passing Meets Graph Neural Networks: A New Paradigm for Massive MIMO Systems

1 code implementation14 Feb 2023 Hengtao He, Xianghao Yu, Jun Zhang, Shenghui Song, Khaled B. Letaief

As one of the core technologies for 5G systems, massive multiple-input multiple-output (MIMO) introduces dramatic capacity improvements along with very high beamforming and spatial multiplexing gains.

AC2C: Adaptively Controlled Two-Hop Communication for Multi-Agent Reinforcement Learning

no code implementations24 Feb 2023 Xuefeng Wang, Xinran Li, Jiawei Shao, Jun Zhang

Learning communication strategies in cooperative multi-agent reinforcement learning (MARL) has recently attracted intensive attention.

Multi-agent Reinforcement Learning reinforcement-learning +2

CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Counting

1 code implementation11 Mar 2023 Simon Graham, Quoc Dang Vu, Mostafa Jahanifar, Martin Weigert, Uwe Schmidt, Wenhua Zhang, Jun Zhang, Sen yang, Jinxi Xiang, Xiyue Wang, Josef Lorenz Rumberger, Elias Baumann, Peter Hirsch, Lihao Liu, Chenyang Hong, Angelica I. Aviles-Rivero, Ayushi Jain, Heeyoung Ahn, Yiyu Hong, Hussam Azzuni, Min Xu, Mohammad Yaqub, Marie-Claire Blache, Benoît Piégu, Bertrand Vernay, Tim Scherr, Moritz Böhland, Katharina Löffler, Jiachen Li, Weiqin Ying, Chixin Wang, Dagmar Kainmueller, Carola-Bibiane Schönlieb, Shuolin Liu, Dhairya Talsania, Yughender Meda, Prakash Mishra, Muhammad Ridzuan, Oliver Neumann, Marcel P. Schilling, Markus Reischl, Ralf Mikut, Banban Huang, Hsiang-Chin Chien, Ching-Ping Wang, Chia-Yen Lee, Hong-Kun Lin, Zaiyi Liu, Xipeng Pan, Chu Han, Jijun Cheng, Muhammad Dawood, Srijay Deshpande, Raja Muhammad Saad Bashir, Adam Shephard, Pedro Costa, João D. Nunes, Aurélio Campilho, Jaime S. Cardoso, Hrishikesh P S, Densen Puthussery, Devika R G, Jiji C V, Ye Zhang, Zijie Fang, Zhifan Lin, Yongbing Zhang, Chunhui Lin, Liukun Zhang, Lijian Mao, Min Wu, Vi Thi-Tuong Vo, Soo-Hyung Kim, Taebum Lee, Satoshi Kondo, Satoshi Kasai, Pranay Dumbhare, Vedant Phuse, Yash Dubey, Ankush Jamthikar, Trinh Thi Le Vuong, Jin Tae Kwak, Dorsa Ziaei, Hyun Jung, Tianyi Miao, David Snead, Shan E Ahmed Raza, Fayyaz Minhas, Nasir M. Rajpoot

Nuclear detection, segmentation and morphometric profiling are essential in helping us further understand the relationship between histology and patient outcome.

Nuclear Segmentation Segmentation +2

DSDP: A Blind Docking Strategy Accelerated by GPUs

no code implementations16 Mar 2023 Yupeng Huang, Hong Zhang, Siyuan Jiang, Dajiong Yue, Xiaohan Lin, Jun Zhang, Yi Qin Gao

In this study, we take the advantage of both traditional and machine-learning based methods, and present a method Deep Site and Docking Pose (DSDP) to improve the performance of blind docking.

Blind Docking Drug Discovery

Low-complexity Deep Video Compression with A Distributed Coding Architecture

1 code implementation21 Mar 2023 Xinjie Zhang, Jiawei Shao, Jun Zhang

This has inspired a distributed coding architecture aiming at reducing the encoding complexity.

Decoder Motion Estimation +1

When Evolutionary Computation Meets Privacy

no code implementations22 Mar 2023 Bowen Zhao, Wei-neng Chen, Xiaoguo Li, Ximeng Liu, Qingqi Pei, Jun Zhang

To this end, in this paper, we discuss three typical optimization paradigms (i. e., \textit{centralized optimization, distributed optimization, and data-driven optimization}) to characterize optimization modes of evolutionary computation and propose BOOM to sort out privacy concerns in evolutionary computation.

Distributed Computing Distributed Optimization +1

Generalized Relation Modeling for Transformer Tracking

1 code implementation CVPR 2023 Shenyuan Gao, Chunluan Zhou, Jun Zhang

Compared with previous two-stream trackers, the recent one-stream tracking pipeline, which allows earlier interaction between the template and search region, has achieved a remarkable performance gain.

Relation

Selective Knowledge Sharing for Privacy-Preserving Federated Distillation without A Good Teacher

1 code implementation4 Apr 2023 Jiawei Shao, Fangzhao Wu, Jun Zhang

While federated learning is promising for privacy-preserving collaborative learning without revealing local data, it remains vulnerable to white-box attacks and struggles to adapt to heterogeneous clients.

Federated Learning Knowledge Distillation +2

Grant-free Massive Random Access with Retransmission: Receiver Optimization and Performance Analysis

no code implementations12 Apr 2023 Xinyu Bian, Yuyi Mao, Jun Zhang

Specifically, by jointly leveraging the user activity correlation between adjacent transmission blocks and the historical channel estimation results, we first develop an activity-correlation-aware receiver for grant-free massive RA systems with retransmission based on the correlated approximate message passing (AMP) algorithm.

Action Detection Activity Detection

CEC: Crowdsourcing-based Evolutionary Computation for Distributed Optimization

no code implementations12 Apr 2023 Feng-Feng Wei, Wei-neng Chen, Xiao-Qi Guo, Bowen Zhao, Sang-Woon Jeon, Jun Zhang

Inspired by this, this paper intends to introduce crowdsourcing into evolutionary computation (EC) to propose a crowdsourcing-based evolutionary computation (CEC) paradigm for distributed optimization.

Distributed Optimization

A Survey on Distributed Evolutionary Computation

no code implementations12 Apr 2023 Wei-neng Chen, Feng-Feng Wei, Tian-Fang Zhao, Kay Chen Tan, Jun Zhang

Based on this taxonomy, existing studies on DEC are reviewed in terms of purpose, parallel structure of the algorithm, parallel model for implementation, and the implementation environment.

Distributed Computing Distributed Optimization

Evaluation of a Canonical Image Representation for Sidescan Sonar

1 code implementation18 Apr 2023 Weiqi Xu, Li Ling, Yiping Xie, Jun Zhang, John Folkesson

In this paper, a canonical transformation method consisting of intensity correction and slant range correction is proposed to decrease the above distortion.

Template Matching

DABS: Data-Agnostic Backdoor attack at the Server in Federated Learning

no code implementations2 May 2023 Wenqiang Sun, Sen Li, Yuchang Sun, Jun Zhang

Federated learning (FL) attempts to train a global model by aggregating local models from distributed devices under the coordination of a central server.

Backdoor Attack Federated Learning

Machine-Learned Invertible Coarse Graining for Multiscale Molecular Modeling

no code implementations2 May 2023 Jun Zhang, Xiaohan Lin, Weinan E, Yi Qin Gao

Multiscale molecular modeling is widely applied in scientific research of molecular properties over large time and length scales.

Novel deep learning methods for 3D flow field segmentation and classification

no code implementations10 May 2023 Xiaorui Bai, Wenyong Wang, Jun Zhang, Yueqing Wang, Yu Xiang

Flow field segmentation and classification help researchers to understand vortex structure and thus turbulent flow.

Classification Segmentation

Understanding and Improving Model Averaging in Federated Learning on Heterogeneous Data

no code implementations13 May 2023 Tailin Zhou, Zehong Lin, Jun Zhang, Danny H. K. Tsang

Based on these findings from our loss landscape visualization and loss decomposition, we propose utilizing iterative moving averaging (IMA) on the global model at the late training phase to reduce its deviation from the expected minimum, while constraining client exploration to limit the maximum distance between the global and client models.

Federated Learning

Task-Oriented Communication with Out-of-Distribution Detection: An Information Bottleneck Framework

1 code implementation21 May 2023 Hongru Li, Wentao Yu, Hengtao He, Jiawei Shao, Shenghui Song, Jun Zhang, Khaled B. Letaief

Task-oriented communication is an emerging paradigm for next-generation communication networks, which extracts and transmits task-relevant information, instead of raw data, for downstream applications.

Informativeness Out-of-Distribution Detection

Joint Activity-Delay Detection and Channel Estimation for Asynchronous Massive Random Access

no code implementations21 May 2023 Xinyu Bian, Yuyi Mao, Jun Zhang

Most existing studies on joint activity detection and channel estimation for grant-free massive random access (RA) systems assume perfect synchronization among all active users, which is hard to achieve in practice.

Action Detection Activity Detection

Towards Large-scale Single-shot Millimeter-wave Imaging for Low-cost Security Inspection

no code implementations25 May 2023 Liheng Bian, Daoyu Li, Shuoguang Wang, Chunyang Teng, Huteng Liu, Hanwen Xu, Xuyang Chang, Guoqiang Zhao, Shiyong Li, Jun Zhang

These elements are then sampled based on the ranking, building the experimentally optimal sparse sampling strategy that reduces the cost of antenna array by up to one order of magnitude.

Image Reconstruction object-detection +1

Channel and Gradient-Importance Aware Device Scheduling for Over-the-Air Federated Learning

no code implementations26 May 2023 Yuchang Sun, Zehong Lin, Yuyi Mao, Shi Jin, Jun Zhang

In this paper, we propose a probabilistic device scheduling framework for over-the-air FL, named PO-FL, to mitigate the negative impact of channel noise, where each device is scheduled according to a certain probability and its model update is reweighted using this probability in aggregation.

Federated Learning Privacy Preserving +1

CIF-PT: Bridging Speech and Text Representations for Spoken Language Understanding via Continuous Integrate-and-Fire Pre-Training

no code implementations27 May 2023 Linhao Dong, Zhecheng An, Peihao Wu, Jun Zhang, Lu Lu, Zejun Ma

We also observe the cross-modal representation extracted by CIF-PT obtains better performance than other neural interfaces for the tasks of SLU, including the dominant speech representation learned from self-supervised pre-training.

intent-classification Intent Classification +5

MimiC: Combating Client Dropouts in Federated Learning by Mimicking Central Updates

1 code implementation21 Jun 2023 Yuchang Sun, Yuyi Mao, Jun Zhang

Federated learning (FL) is a promising framework for privacy-preserving collaborative learning, where model training tasks are distributed to clients and only the model updates need to be collected at a server.

Federated Learning Privacy Preserving

Cannot find the paper you are looking for? You can Submit a new open access paper.