Search Results for author: Peng Zhang

Found 132 papers, 48 papers with code

HOSMEL: A Hot-Swappable Modularized Entity Linking Toolkit for Chinese

1 code implementation ACL 2022 Daniel Zhang-li, Jing Zhang, Jifan Yu, Xiaokang Zhang, Peng Zhang, Jie Tang, Juanzi Li

We investigate the usage of entity linking (EL)in downstream tasks and present the first modularized EL toolkit for easy task adaptation.

Entity Linking Question Answering

Natural Language Processing Meets Quantum Physics: A Survey and Categorization

no code implementations EMNLP 2021 Sixuan Wu, Jian Li, Peng Zhang, Yue Zhang

Recent research has investigated quantum NLP, designing algorithms that process natural language in quantum computers, and also quantum-inspired algorithms that improve NLP performance on classical computers.

ClusterFormer: Neural Clustering Attention for Efficient and Effective Transformer

no code implementations ACL 2022 Ningning Wang, Guobing Gan, Peng Zhang, Shuai Zhang, Junqiu Wei, Qun Liu, Xin Jiang

Other sparse methods use clustering patterns to select words, but the clustering process is separate from the training process of the target task, which causes a decrease in effectiveness.

Machine Translation Natural Language Inference +3

Binary stochasticity enabled highly efficient neuromorphic deep learning achieves better-than-software accuracy

no code implementations25 Apr 2023 Yang Li, Wei Wang, Ming Wang, Chunmeng Dou, Zhengyu Ma, Huihui Zhou, Peng Zhang, Nicola Lepri, Xumeng Zhang, Qing Luo, Xiaoxin Xu, Guanhua Yang, Feng Zhang, Ling Li, Daniele Ielmini, Ming Liu

We propose a binary stochastic learning algorithm that modifies all elementary neural network operations, by introducing (i) stochastic binarization of both the forwarding signals and the activation function derivatives, (ii) signed binarization of the backpropagating errors, and (iii) step-wised weight updates.


Triple Structural Information Modelling for Accurate, Explainable and Interactive Recommendation

no code implementations23 Apr 2023 Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

Specifically, TriSIM4Rec consists of 1) a dynamic ideal low-pass graph filter to dynamically mine co-occurrence information in user-item interactions, which is implemented by incremental singular value decomposition (SVD); 2) a parameter-free attention module to capture sequential information of user interactions effectively and efficiently; and 3) an item transition matrix to store the transition probabilities of item pairs.

Collaborative Filtering

NovPhy: A Testbed for Physical Reasoning in Open-world Environments

1 code implementation3 Mar 2023 Chathura Gamage, Vimukthini Pinto, Cheng Xue, Peng Zhang, Ekaterina Nikonova, Matthew Stephenson, Jochen Renz

But is it enough to only have physical reasoning capabilities to operate in a real physical environment?

A network-based biomarkers discovery of Cold/Hot ZHENG chronic gastritis and Cold/Hot herbs of formulae

no code implementations10 Feb 2023 Boyang Wang, Pan Chen, Peng Zhang, Shao Li

And we collected 25 formulae (with traditional effects related to Cold/Hot ZHENG) for CG and corresponding 89 Cold/Hot herbs (including Warm/Cool herbs) to discover features and construct target networks of Cold/Hot herbs on the basis of network target and enrichment analysis.

Personalized Graph Signal Processing for Collaborative Filtering

no code implementations4 Feb 2023 Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

However, the interaction signal may not be sufficient to accurately characterize user interests and the low-pass filters may ignore the useful information contained in the high-frequency component of the observed signals, resulting in suboptimal accuracy.

Collaborative Filtering

ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editing

no code implementations31 Jan 2023 Bingchuan Li, Tianxiang Ma, Peng Zhang, Miao Hua, Wei Liu, Qian He, Zili Yi

Specifically, in Phase I, a W-space-oriented StyleGAN inversion network is trained and used to perform image inversion and editing, which assures the editability but sacrifices reconstruction quality.

Image Generation

Model Based Reinforcement Learning with Non-Gaussian Environment Dynamics and its Application to Portfolio Optimization

no code implementations23 Jan 2023 Huifang Huang, Ting Gao, Pengbo Li, Jin Guo, Peng Zhang, Nan Du

With the fast development of quantitative portfolio optimization in financial engineering, lots of AI-based algorithmic trading strategies have demonstrated promising results, among which reinforcement learning begins to manifest competitive advantages.

Algorithmic Trading Decision Making +5

GIPA: A General Information Propagation Algorithm for Graph Learning

1 code implementation19 Jan 2023 Houyi Li, Zhihong Chen, Zhao Li, Qinkai Zheng, Peng Zhang, Shuigeng Zhou

Specifically, the bit-wise correlation calculates the element-wise attention weight through a multi-layer perceptron (MLP) based on the dense representations of two nodes and their edge; The feature-wise correlation is based on the one-hot representations of node attribute features for feature selection.

feature selection Graph Learning +2

CL4CTR: A Contrastive Learning Framework for CTR Prediction

1 code implementation1 Dec 2022 Fangye Wang, Yingxu Wang, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

Many Click-Through Rate (CTR) prediction works focused on designing advanced architectures to model complex feature interactions but neglected the importance of feature representation learning, e. g., adopting a plain embedding layer for each feature, which results in sub-optimal feature representations and thus inferior CTR prediction performance.

Click-Through Rate Prediction Contrastive Learning +3

AS-PD: An Arbitrary-Size Downsampling Framework for Point Clouds

no code implementations2 Nov 2022 Peng Zhang, Ruoyin Xie, Jinsheng Sun, Weiqing Li, Zhiyong Su

Given an input point cloud of arbitrary size, we first perform a task-agnostic pre-sampling on the input point cloud to a specified sample size.

Parameter-free Dynamic Graph Embedding for Link Prediction

1 code implementation15 Oct 2022 Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

Dynamic interaction graphs have been widely adopted to model the evolution of user-item interactions over time.

Dynamic graph embedding Link Prediction

DART: Articulated Hand Model with Diverse Accessories and Rich Textures

1 code implementation14 Oct 2022 Daiheng Gao, Yuliang Xiu, Kailin Li, Lixin Yang, Feng Wang, Peng Zhang, Bang Zhang, Cewu Lu, Ping Tan

Unity GUI is also provided to generate synthetic hand data with user-defined settings, e. g., pose, camera, background, lighting, textures, and accessories.

Hand Pose Estimation Unity

Multi-Scale Wavelet Transformer for Face Forgery Detection

no code implementations8 Oct 2022 Jie Liu, Jingjing Wang, Peng Zhang, Chunmao Wang, Di Xie, ShiLiang Pu

To overcome these limitations, we propose a multi-scale wavelet transformer framework for face forgery detection.

Enhanced Secure Wireless Transmission Using IRS-aided Directional Modulation

no code implementations29 Sep 2022 Yeqing Lin, Rongen Dong, Peng Zhang, Feng Shu, Jiangzhou Wang

To reduce the computational complexity, a new method of maximizing receive power with zero-forcing constraint (Max-RP-ZFC) of only reflecting CM and no AN is proposed.

Multi-frequency PolSAR Image Fusion Classification Based on Semantic Interactive Information and Topological Structure

no code implementations5 Sep 2022 Yice Cao, Yan Wu, Ming Li, Mingjie Zheng, Peng Zhang, Jili Wang

Finally, an adaptive weighting fusion (AWF) strategy is proposed to merge inference from different bands, so as to make the MF joint classification decisions of SIC and TPC.

Classification Image Classification +1

Neuro-Dynamic State Estimation for Networked Microgrids

no code implementations25 Aug 2022 Fei Feng, Yifan Zhou, Peng Zhang

We devise neuro-dynamic state estimation (Neuro-DSE), a learning-based dynamic state estimation (DSE) algorithm for networked microgrids (NMs) under unknown subsystems.

AMinerGNN: Heterogeneous Graph Neural Network for Paper Click-through Rate Prediction with Fusion Query

no code implementations15 Aug 2022 Zepeng Huai, Zhe Wang, Yifan Zhu, Peng Zhang

Paper recommendation with user-generated keyword is to suggest papers that simultaneously meet user's interests and are relevant to the input keyword.

Click-Through Rate Prediction Graph Representation Learning +1

Measuring Difficulty of Novelty Reaction

no code implementations28 Jul 2022 Ekaterina Nikonova, Cheng Xue, Vimukthini Pinto, Chathura Gamage, Peng Zhang, Jochen Renz

In this paper, we propose to define the novelty reaction difficulty as a relative difficulty of performing the known task after the introduction of the novelty.

Subgraph Neighboring Relations Infomax for Inductive Link Prediction on Knowledge Graphs

1 code implementation28 Jul 2022 Xiaohan Xu, Peng Zhang, Yongquan He, Chengpeng Chao, Chaoyang Yan

Inductive link prediction for knowledge graph aims at predicting missing links between unseen entities, those not shown in training stage.

Inductive Link Prediction Knowledge Graphs

TRIE++: Towards End-to-End Information Extraction from Visually Rich Documents

no code implementations14 Jul 2022 Zhanzhan Cheng, Peng Zhang, Can Li, Qiao Liang, Yunlu Xu, Pengfei Li, ShiLiang Pu, Yi Niu, Fei Wu

Most existing methods divide this task into two subparts: the text reading part for obtaining the plain text from the original document images and the information extraction part for extracting key contents.

Language Modelling

A Framework Based on Generational and Environmental Response Strategies for Dynamic Multi-objective Optimization

no code implementations6 Jul 2022 Qingya Li, Xiangzhi Liu, Fuqiang Wang, Shuai Wang, Peng Zhang, Xiaoming Wu

In this paper, a novel framework based on generational and environmental response strategies (FGERS) is proposed, in which response strategies are run both in the environmental change stage and the environmental static stage to obtain population evolution information of those both stages.

Measurement of carbon finance level and exploration of its influencing factors

no code implementations1 Jun 2022 Peng Zhang, Yuwei Zhang, Nuo Xu

Faced with increasingly severe environmental problems, carbon trading markets and related financial activities aiming at limiting carbon dioxide emissions are booming.

Resilience in Industrial Internet of Things Systems: A Communication Perspective

no code implementations1 Jun 2022 Hao Wu, Yifan Miao, Peng Zhang, Yang Tian, Hui Tian

Industrial Internet of Things is an ultra-large-scale system that is much more sophisticated and fragile than conventional industrial platforms.


Stock Trading Optimization through Model-based Reinforcement Learning with Resistance Support Relative Strength

no code implementations30 May 2022 Huifang Huang, Ting Gao, Yi Gui, Jin Guo, Peng Zhang

Reinforcement learning (RL) is gaining attention by more and more researchers in quantitative finance as the agent-environment interaction framework is aligned with decision making process in many business problems.

Decision Making Model-based Reinforcement Learning +2

AI-aided multiscale modeling of physiologically-significant blood clots

no code implementations25 May 2022 Yicong Zhu, Changnian Han, Peng Zhang, Guojing Cong, James R. Kozloski, Chih-Chieh Yang, Leili Zhang, Yuefan Deng

We have developed an AI-aided multiple time stepping (AI-MTS) algorithm and multiscale modeling framework (AI-MSM) and implemented them on the Summit-like supercomputer, AIMOS.

Rapid Phase Ambiguity Elimination Methods for DOA Estimator via Hybrid Massive MIMO Receive Array

no code implementations27 Apr 2022 Xichao Zhan, YiWen Chen, Feng Shu, Xin Cheng, Yuanyuan Wu, Qi Zhang, Yifang Li, Peng Zhang

In the proposed Max-RP-QI, a quadratic interpolation scheme is adopted to interpolate the three DOA values corresponding to the largest three receive powers of Max-RP.

Enhancing CTR Prediction with Context-Aware Feature Representation Learning

1 code implementation19 Apr 2022 Fangye Wang, Yingxu Wang, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

However, most methods only learn a fixed representation for each feature without considering the varying importance of each feature under different contexts, resulting in inferior performance.

Click-Through Rate Prediction Representation Learning

A Multi-Metric Latent Factor Model for Analyzing High-Dimensional and Sparse data

no code implementations16 Apr 2022 Di wu, Peng Zhang, Yi He, Xin Luo

High-dimensional and sparse (HiDS) matrices are omnipresent in a variety of big data-related applications.

Representation Learning

Personalized Image Aesthetics Assessment with Rich Attributes

no code implementations CVPR 2022 Yuzhe Yang, Liwu Xu, Leida Li, Nan Qie, Yaqian Li, Peng Zhang, Yandong Guo

To solve the dilemma, we conduct so far, the most comprehensive subjective study of personalized image aesthetics and introduce a new Personalized image Aesthetics database with Rich Attributes (PARA), which consists of 31, 220 images with annotations by 438 subjects.

An Audio-Visual Attention Based Multimodal Network for Fake Talking Face Videos Detection

no code implementations10 Mar 2022 Ganglai Wang, Peng Zhang, Lei Xie, Wei Huang, Yufei zha, Yanning Zhang

DeepFake based digital facial forgery is threatening the public media security, especially when lip manipulation has been used in talking face generation, the difficulty of fake video detection is further improved.

Decision Making Face Detection +2

Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wild

no code implementations8 Mar 2022 Ganglai Wang, Peng Zhang, Lei Xie, Wei Huang, Yufei zha

Rather than focusing on the unimportant regions of the face image, the proposed AttnWav2Lip model is able to pay more attention on the lip region reconstruction.

Talking Face Generation

Audio-visual speech separation based on joint feature representation with cross-modal attention

no code implementations5 Mar 2022 Junwen Xiong, Peng Zhang, Lei Xie, Wei Huang, Yufei zha, Yanning Zhang

Multi-modal based speech separation has exhibited a specific advantage on isolating the target character in multi-talker noisy environments.

Optical Flow Estimation Speech Separation

Look\&Listen: Multi-Modal Correlation Learning for Active Speaker Detection and Speech Enhancement

1 code implementation4 Mar 2022 Junwen Xiong, Yu Zhou, Peng Zhang, Lei Xie, Wei Huang, Yufei zha

Active speaker detection and speech enhancement have become two increasingly attractive topics in audio-visual scenario understanding.

Multi-Task Learning Speech Enhancement

Absolute Zero-Shot Learning

no code implementations23 Feb 2022 Rui Gao, Fan Wan, Daniel Organisciak, Jiyao Pu, Junyan Wang, Haoran Duan, Peng Zhang, Xingsong Hou, Yang Long

Considering the increasing concerns about data copyright and privacy issues, we present a novel Absolute Zero-Shot Learning (AZSL) paradigm, i. e., training a classifier with zero real data.

Transfer Learning Zero-Shot Learning

Learning Multiple Explainable and Generalizable Cues for Face Anti-spoofing

no code implementations21 Feb 2022 Ying Bian, Peng Zhang, Jingjing Wang, Chunmao Wang, ShiLiang Pu

However, many other generalizable cues are unexplored for face anti-spoofing, which limits their performance under cross-dataset testing.

Face Anti-Spoofing

AD-NEGF: An End-to-End Differentiable Quantum Transport Simulator for Sensitivity Analysis and Inverse Problems

no code implementations10 Feb 2022 Yingzhanghao Zhou, Xiang Chen, Peng Zhang, Jun Wang, Lei Wang, Hong Guo

Since proposed in the 70s, the Non-Equilibrium Green Function (NEGF) method has been recognized as a standard approach to quantum transport simulations.

Signal Shaping for Semantic Communication Systems with A Few Message Candidates

no code implementations4 Feb 2022 Shuaishuai Guo, Yanhu Wang, Peng Zhang

Semantic communications target to reliably convey the semantic meaning of messages.

Automated assessment of disease severity of COVID-19 using artificial intelligence with synthetic chest CT

no code implementations11 Dec 2021 Mengqiu Liu, Ying Liu, Yidong Yang, Aiping Liu, Shana Li, Changbing Qu, Xiaohui Qiu, Yang Li, Weifu Lv, Peng Zhang, Jie Wen

Correlations between imaging findings and clinical lab tests suggested the value of this system as a potential tool to assess disease severity of COVID-19.

Data Augmentation Lesion Segmentation

Prior Attention Network for Multi-Lesion Segmentation in Medical Images

1 code implementation10 Oct 2021 Xiangyu Zhao, Peng Zhang, Fan Song, Chenbin Ma, Guangda Fan, Yangyang Sun, Youdan Feng, Guanglei Zhang

The proposed network can be regarded as a universal solution to multi-lesion segmentation in both 2D and 3D tasks.

Lesion Segmentation

Modeling Variable Space with Residual Tensor Networks for Multivariate Time Series

no code implementations29 Sep 2021 Jing Zhang, Peng Zhang, Yupeng He, Siwei Rao, Jun Wang, Guangjian Tian

In this framework, we derive the mathematical representation of the variable space, and then use a tensor network based on the idea of low-rank approximation to model the variable space.

Multivariate Time Series Forecasting Tensor Networks +1

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

1 code implementation22 Sep 2021 Bingchuan Li, Shaofei Cai, Wei Liu, Peng Zhang, Qian He, Miao Hua, Zili Yi

To address these limitations, we design a Dynamic Style Manipulation Network (DyStyle) whose structure and parameters vary by input samples, to perform nonlinear and adaptive manipulation of latent codes for flexible and precise attribute control.

Contrastive Learning

Phy-Q as a measure for physical reasoning intelligence

1 code implementation31 Aug 2021 Cheng Xue, Vimukthini Pinto, Chathura Gamage, Ekaterina Nikonova, Peng Zhang, Jochen Renz

Inspired by how human IQ is calculated, we define the physical reasoning quotient (Phy-Q score) that reflects the physical reasoning intelligence of an agent using the physical scenarios we considered.

Graph Contrastive Learning for Anomaly Detection

2 code implementations17 Aug 2021 Bo Chen, Jing Zhang, Xiaokang Zhang, Yuxiao Dong, Jian Song, Peng Zhang, Kaibo Xu, Evgeny Kharlamov, Jie Tang

To achieve the contrastive objective, we design a graph neural network encoder that can infer and further remove suspicious links during message passing, as well as learn the global context of the input graph.

Anomaly Detection Binary Classification +2

Unsupervised Cross-Modal Distillation for Thermal Infrared Tracking

1 code implementation31 Jul 2021 Jingxian Sun, Lichao Zhang, Yufei zha, Abel Gonzalez-Garcia, Peng Zhang, Wei Huang, Yanning Zhang

To solve this problem, we propose to distill representations of the TIR modality from the RGB modality with Cross-Modal Distillation (CMD) on a large amount of unlabeled paired RGB-TIR data.

Transfer Learning

Hi-Phy: A Benchmark for Hierarchical Physical Reasoning

1 code implementation17 Jun 2021 Cheng Xue, Vimukthini Pinto, Chathura Gamage, Peng Zhang, Jochen Renz

In this paper, we propose a new benchmark for physical reasoning that allows us to test individual physical reasoning capabilities.

WASE: Learning When to Attend for Speaker Extraction in Cocktail Party Environments

1 code implementation13 Jun 2021 Yunzhe Hao, Jiaming Xu, Peng Zhang, Bo Xu

In the speaker extraction problem, it is found that additional information from the target speaker contributes to the tracking and extraction of the target speaker, which includes voiceprint, lip movement, facial expression, and spatial information.

Action Detection Activity Detection

Path-based Deep Network for Candidate Item Matching in Recommenders

no code implementations18 May 2021 Houyi Li, Zhihong Chen, Chenliang Li, Rong Xiao, Hongbo Deng, Peng Zhang, Yongchao Liu, Haihong Tang

PDN utilizes Trigger Net to capture the user's interest in each of his/her interacted item, and Similarity Net to evaluate the similarity between each interacted item and the target item based on these items' profile and CF information.

Recommendation Systems Retrieval

GIPA: General Information Propagation Algorithm for Graph Learning

2 code implementations13 May 2021 Qinkai Zheng, Houyi Li, Peng Zhang, Zhixiong Yang, Guowei Zhang, Xintan Zeng, Yongchao Liu

Graph neural networks (GNNs) have been popularly used in analyzing graph-structured data, showing promising results in various applications such as node classification, link prediction and network recommendation.

Graph Attention Graph Learning +2

LGPMA: Complicated Table Structure Recognition with Local and Global Pyramid Mask Alignment

1 code implementation13 May 2021 Liang Qiao, Zaisheng Li, Zhanzhan Cheng, Peng Zhang, ShiLiang Pu, Yi Niu, Wenqi Ren, Wenming Tan, Fei Wu

In this paper, we aim to obtain more reliable aligned bounding boxes by fully utilizing the visual information from both text regions in proposed local features and cell relations in global features.

Table Recognition

VSR: A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relations

no code implementations13 May 2021 Peng Zhang, Can Li, Liang Qiao, Zhanzhan Cheng, ShiLiang Pu, Yi Niu, Fei Wu

To address the above limitations, we propose a unified framework VSR for document layout analysis, combining vision, semantics and relations.

Document Layout Analysis

A Feature Fusion-Net Using Deep Spatial Context Encoder and Nonstationary Joint Statistical Model for High Resolution SAR Image Classification

no code implementations11 May 2021 Wenkai Liang, Yan Wu, Ming Li, Peng Zhang, Yice Cao, Xin Hu

To address this problem, a novel end-to-end supervised classification method is proposed for HR SAR images by considering both spatial context and statistical features.

Image Classification

GraphTheta: A Distributed Graph Neural Network Learning System With Flexible Training Strategy

1 code implementation21 Apr 2021 Yongchao Liu, Houyi Li, Guowei Zhang, Xintan Zeng, Yongyong Li, Bin Huang, Peng Zhang, Zhao Li, Xiaowei Zhu, Changhua He, WenGuang Chen

Herein, we present GraphTheta, the first distributed and scalable graph learning system built upon vertex-centric distributed graph processing with neural network operators implemented as user-defined functions.

Graph Learning

Noise-Resilient Quantum Machine Learning for Stability Assessment of Power Systems

no code implementations10 Apr 2021 Yifan Zhou, Peng Zhang

Transient stability assessment (TSA) is a cornerstone for resilient operations of today's interconnected power grids.

BIG-bench Machine Learning Quantum Machine Learning

A review of artificial intelligence methods combined with Raman spectroscopy to identify the composition of substances

no code implementations5 Apr 2021 Liangrui Pan, Peng Zhang, Chalongrat Daengngam, Mitchai Chongcheawchamnan

This review summarizes the work of Raman spectroscopy in identifying the composition of substances and reviews the preprocessing process of Raman spectroscopy, the analysis methods and applications of artificial intelligence.

OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services

1 code implementation3 Mar 2021 Xiao Liu, Da Yin, Jingnan Zheng, Xingjian Zhang, Peng Zhang, Hongxia Yang, Yuxiao Dong, Jie Tang

Academic knowledge services have substantially facilitated the development of the science enterprise by providing a plenitude of efficient research tools.

Language Modelling Link Prediction

CogDL: A Comprehensive Library for Graph Deep Learning

1 code implementation1 Mar 2021 Yukuo Cen, Zhenyu Hou, Yan Wang, Qibin Chen, Yizhen Luo, Zhongming Yu, Hengrui Zhang, Xingcheng Yao, Aohan Zeng, Shiguang Guo, Yuxiao Dong, Yang Yang, Peng Zhang, Guohao Dai, Yu Wang, Chang Zhou, Hongxia Yang, Jie Tang

In CogDL, we propose a unified design for the training and evaluation of GNN models for various graph tasks, making it unique among existing graph learning libraries.

Graph Classification Graph Embedding +5

D2A U-Net: Automatic Segmentation of COVID-19 Lesions from CT Slices with Dilated Convolution and Dual Attention Mechanism

1 code implementation10 Feb 2021 Xiangyu Zhao, Peng Zhang, Fan Song, Guangda Fan, Yangyang Sun, Yujia Wang, Zheyuan Tian, Luqi Zhang, Guanglei Zhang

In this paper we propose a dilated dual attention U-Net (D2A U-Net) for COVID-19 lesion segmentation in CT slices based on dilated convolution and a novel dual attention mechanism to address the issues above.

Computed Tomography (CT) Lesion Segmentation +1

Neuro-Reachability of Networked Microgrids

no code implementations13 Jan 2021 Yifan Zhou, Peng Zhang

A neural ordinary differential equations network (ODE-Net)-enabled reachability method (Neuro-Reachability) is devised for the dynamic verification of networked microgrids (NMs) with unidentified subsystems and heterogeneous uncertainties.

Model Discovery

TextTN: Probabilistic Encoding of Language on Tensor Network

no code implementations1 Jan 2021 Peng Zhang, Jing Zhang, Xindian Ma, Siwei Rao, Guangjian Tian, Jun Wang

As a novel model that bridges machine learning and quantum theory, tensor network (TN) has recently gained increasing attention and successful applications for processing natural images.

General Classification Sentiment Analysis +3

Fluctuations in crystalline plasticity

no code implementations23 Dec 2020 Jérôme Weiss, Peng Zhang, Oguz Umut Salman, Gang Liu, Lev Truskinovsky

We link this new size effect with other related phenomena like size dependence of strength ("smaller is stronger") and the size induced switch between different hardening mechanisms.

Mesoscale and Nanoscale Physics Materials Science Statistical Mechanics Computational Physics

Residual Matrix Product State for Machine Learning

no code implementations22 Dec 2020 Ye-Ming Meng, Jing Zhang, Peng Zhang, Chao GAO, Shi-Ju Ran

Tensor network, which originates from quantum physics, is emerging as an efficient tool for classical and quantum machine learning.

BIG-bench Machine Learning Quantum Machine Learning +1

A New Many-Objective Evolutionary Algorithm Based on Determinantal Point Processes

no code implementations15 Dec 2020 Peng Zhang, Jinlong Li, Tengfei Li, Huanhuan Chen

To handle different types of Many-Objective Optimization Problems (MaOPs), Many-Objective Evolutionary Algorithms (MaOEAs) need to simultaneously maintain convergence and population diversity in the high-dimensional objective space.

Point Processes

CODE: Contrastive Pre-training with Adversarial Fine-tuning for Zero-shot Expert Linking

2 code implementations14 Dec 2020 Bo Chen, Jing Zhang, Xiaokang Zhang, Xiaobin Tang, Lingfan Cai, Hong Chen, Cuiping Li, Peng Zhang, Jie Tang

In this paper, we propose CODE, which first pre-trains an expert linking model by contrastive learning on AMiner such that it can capture the representation and matching patterns of experts without supervised signals, then it is fine-tuned between AMiner and external sources to enhance the models transferability in an adversarial manner.

Active Learning Contrastive Learning +2

Audio-visual Speech Separation with Adversarially Disentangled Visual Representation

no code implementations29 Nov 2020 Peng Zhang, Jiaming Xu, Jing Shi, Yunzhe Hao, Bo Xu

In our model, we use the face detector to detect the number of speakers in the scene and use visual information to avoid the permutation problem.

Speech Separation

Nonlinear Cooperative Control of Double Drone-Bar Transportation System

no code implementations15 Nov 2020 Peng Zhang, Yongchun Fang, Xiao Liang, He Lin, wei he

Due to the limitation of the drone's load capacity, various specific tasks need to be accomplished by multiple drones in collaboration.

Dynamical Systems Systems and Control Systems and Control

Noise Reduction Technique for Raman Spectrum using Deep Learning Network

no code implementations9 Sep 2020 Liangrui Pan, Pronthep Pipitsunthonsan, Peng Zhang, Chalongrat Daengngam, Apidach Booranawong, Mitcham Chongcheawchamnan

It is shown that output SNR of the proposed noise reduction technology is 10. 24 dB greater than that of the wavelet noise reduction method while the RMSE and the MAPE are 292. 63 and 10. 09, which are much better than the proposed technique.

TensorCoder: Dimension-Wise Attention via Tensor Representation for Natural Language Modeling

no code implementations28 Jul 2020 Shuai Zhang, Peng Zhang, Xindian Ma, Junqiu Wei, Ningning Wang, Qun Liu

Transformer has been widely-used in many Natural Language Processing (NLP) tasks and the scaled dot-product attention between tokens is a core module of Transformer.

Language Modelling Machine Translation +2

Signal Shaping for Non-Uniform Beamspace Modulated mmWave Hybrid MIMO Communications

no code implementations23 Jun 2020 Shuaishuai Guo, Haixia Zhang, Peng Zhang, Shuping Zhang, Chengcheng Xu, Mohamed-Slim Alouini

Specifically, we firstly propose a joint optimization based signal shaping (JOSS) approach, in which the symbol vector sets used for all analog precoder activation states are jointly optimized by solving a series of quadratically constrained quadratic programming (QCQP) problems.

TRIE: End-to-End Text Reading and Information Extraction for Document Understanding

1 code implementation27 May 2020 Peng Zhang, Yunlu Xu, Zhanzhan Cheng, ShiLiang Pu, Jing Lu, Liang Qiao, Yi Niu, Fei Wu

Since real-world ubiquitous documents (e. g., invoices, tickets, resumes and leaflets) contain rich information, automatic document image understanding has become a hot topic.

Revisiting Regex Generation for Modeling Industrial Applications by Incorporating Byte Pair Encoder

no code implementations6 May 2020 De-Sheng Wang, Jiawei Liu, Xiang Qi, Baolin Sun, Peng Zhang

The results demonstrate the effectiveness of our method, which outperforms the baseline on 10 kinds of data and achieves nearly 50 percent improvement on average.

Deep Reinforcement Learning (DRL): Another Perspective for Unsupervised Wireless Localization

no code implementations9 Apr 2020 You Li, Xin Hu, Yuan Zhuang, Zhouzheng Gao, Peng Zhang, Naser El-Sheimy

However, it is challenging to use low-cost IoT devices for robust unsupervised localization (i. e., localization without training data that have known location labels).

reinforcement-learning Reinforcement Learning (RL)

Optimizing Streaming Parallelism on Heterogeneous Many-Core Architectures: A Machine Learning Based Approach

1 code implementation5 Mar 2020 Peng Zhang, Jianbin Fang, Canqun Yang, Chun Huang, Tao Tang, Zheng Wang

This article presents an automatic approach to quickly derive a good solution for hardware resource partition and task granularity for task-based parallel applications on heterogeneous many-core architectures.

BIG-bench Machine Learning

KoGuN: Accelerating Deep Reinforcement Learning via Integrating Human Suboptimal Knowledge

no code implementations18 Feb 2020 Peng Zhang, Jianye Hao, Weixun Wang, Hongyao Tang, Yi Ma, Yihai Duan, Yan Zheng

Our framework consists of a fuzzy rule controller to represent human knowledge and a refine module to fine-tune suboptimal prior knowledge.

Common Sense Reasoning Continuous Control +2

Encoding word order in complex embeddings

1 code implementation ICLR 2020 Benyou Wang, Donghao Zhao, Christina Lioma, Qiuchi Li, Peng Zhang, Jakob Grue Simonsen

The benefit of continuous functions over variable positions is that word representations shift smoothly with increasing positions.

Language Modelling Machine Translation +4

Reflecting Modulation

no code implementations18 Dec 2019 Shuaishuai Guo, Shuheng Lv, Haixia Zhang, Jia Ye, Peng Zhang

This paper proposes a reflecting modulation (RM) scheme for RIS-based communications, where both the reflecting patterns and transmit signals can carry information.

Kernelized Similarity Learning and Embedding for Dynamic Texture Synthesis

1 code implementation11 Nov 2019 Shiming Chen, Peng Zhang, Guo-Sen Xie, Qinmu Peng, Zehong Cao, Wei Yuan, Xinge You

Dynamic texture (DT) exhibits statistical stationarity in the spatial domain and stochastic repetitiveness in the temporal dimension, indicating that different frames of DT possess a high similarity correlation that is critical prior knowledge.

Texture Synthesis

Balancing covariates in randomized experiments with the Gram-Schmidt Walk design

1 code implementation8 Nov 2019 Christopher Harshaw, Fredrik Sävje, Daniel Spielman, Peng Zhang

The design of experiments involves an inescapable compromise between covariate balance and robustness.

Methodology Data Structures and Algorithms Statistics Theory Statistics Theory

Interpretable Network Structure for Modeling Contextual Dependency

no code implementations25 Sep 2019 Xindian Ma, Peng Zhang, Xiaoliu Mao, Yehua Zhang, Nan Duan, Yuexian Hou, Ming Zhou.

Then, we show that the lower bound of such a separation rank can reveal the quantitative relation between the network structure (e. g. depth/width) and the modeling ability for the contextual dependency.

Language Modelling Sentence Classification

Leveraging Entanglement Entropy for Deep Understanding of Attention Matrix in Text Matching

no code implementations25 Sep 2019 Peng Zhang, Xiaoliu Mao, Xindian Ma, Benyou Wang, Jing Zhang, Jun Wang, Dawei Song

We prove that by a mapping (via the trace operator) on the high-dimensional matching matrix, a low-dimensional attention matrix can be derived.

Inductive Bias Question Answering +1

CASA-NLU: Context-Aware Self-Attentive Natural Language Understanding for Task-Oriented Chatbots

no code implementations IJCNLP 2019 Arshit Gupta, Peng Zhang, Garima Lalwani, Mona Diab

In this work, we propose a context-aware self-attentive NLU (CASA-NLU) model that uses multiple signals, such as previous intents, slots, dialog acts and utterances over a variable context window, in addition to the current user utterance.

Dialogue Management intent-classification +3

MarlRank: Multi-agent Reinforced Learning to Rank

no code implementations15 Sep 2019 Shihao Zou, Zhonghua Li, Mohammad Akbari, Jun Wang, Peng Zhang

By defining reward as a function of NDCG, we can optimize our model directly on the ranking performance measure.

Document Ranking Learning-To-Rank

Explainable Video Action Reasoning via Prior Knowledge and State Transitions

1 code implementation28 Aug 2019 Tao Zhuo, Zhiyong Cheng, Peng Zhang, Yongkang Wong, Mohan Kankanhalli

Finally, by sequentially examining each state transition in the video graph, our method can detect and explain how those actions are executed with prior knowledge, just like the logical manner of thinking by humans.

Action Analysis

A new Majorana platform in an Fe-As bilayer superconductor

no code implementations1 Jul 2019 Wenyao Liu, Lu Cao, Shiyu Zhu, Lingyuan Kong, Guangwei Wang, Michal Papaj, Peng Zhang, Yabin Liu, Hui Chen, Geng Li, Fazhi Yang, Takeshi Kondo, Shixuan Du, Guanghan Cao, Shik Shin, Liang Fu, Zhiping Yin, Hong-Jun Gao, Hong Ding

On the other hand, some iron-pnictide (Fe-As) superconductors, such as LiFeAs, have been demonstrated to have a similar topological band structure, yet no MZM has been observed in its vortex cores, raising a question of universality of MZM presence in iron-based superconductors.

Superconductivity Strongly Correlated Electrons

A Tensorized Transformer for Language Modeling

1 code implementation NeurIPS 2019 Xindian Ma, Peng Zhang, Shuai Zhang, Nan Duan, Yuexian Hou, Dawei Song, Ming Zhou

In this paper, based on the ideas of tensor decomposition and parameters sharing, we propose a novel self-attention model (namely Multi-linear attention) with Block-Term Tensor Decomposition (BTD).

Language Modelling Machine Translation +2

Using Restart Heuristics to Improve Agent Performance in Angry Birds

1 code implementation30 May 2019 Tommy Liu, Jochen Renz, Peng Zhang, Matthew Stephenson

Over the past few years the Angry Birds AI competition has been held in an attempt to develop intelligent agents that can successfully and efficiently solve levels for the video game Angry Birds.

Support Relation Analysis for Objects in Multiple View RGB-D Images

no code implementations10 May 2019 Peng Zhang, Xiaoyu Ge, Jochen Renz

Understanding physical relations between objects, especially their support relations, is crucial for robotic manipulation.

GraphNAS: Graph Neural Architecture Search with Reinforcement Learning

1 code implementation22 Apr 2019 Yang Gao, Hong Yang, Peng Zhang, Chuan Zhou, Yue Hu

On node classification tasks, GraphNAS can design a novel network architecture that rivals the best human-invented architecture in terms of test set accuracy.

General Classification Neural Architecture Search +3

Enhancing the long-term performance of recommender system

no code implementations1 Apr 2019 Leyang Xue, Peng Zhang, An Zeng

Notably, an optimal parameter n* of ARL existed in long-term recommendation, indicating that there is a trade-off between keeping diversity of item and user's preference to maximize the long-term recommendation accuracy.

Recommendation Systems

Predictability of diffusion-based recommender systems

no code implementations29 Mar 2019 Peng Zhang, Leyang Xue, An Zeng

The results show that the higher recommendation accuracy based on diffusion algorithms can still be achieved by optimizing the way of resource allocation on a density network.

Recommendation Systems

Predicting tongue motion in unlabeled ultrasound videos using convolutional LSTM neural network

1 code implementation19 Feb 2019 Chaojie Zhao, Peng Zhang, Jian Zhu, Chengrui Wu, Huaimin Wang, Kele Xu

A challenge in speech production research is to predict future tongue movements based on a short period of past tongue movements.

motion prediction

Clustering Bioactive Molecules in 3D Chemical Space with Unsupervised Deep Learning

no code implementations9 Feb 2019 Chu Qin, Ying Tan, Shang Ying Chen, Xian Zeng, Xingxing Qi, Tian Jin, Huan Shi, Yiwei Wan, Yu Chen, Jingfeng Li, Weidong He, Yali Wang, Peng Zhang, Feng Zhu, Hongping Zhao, Yuyang Jiang, Yuzong Chen

We ex-plored the superior learning capability of deep autoencoders for unsupervised clustering of 1. 39 mil-lion bioactive molecules into band-clusters in a 3-dimensional latent chemical space.

Drug Discovery

A Generalized Language Model in Tensor Space

1 code implementation31 Jan 2019 Lipeng Zhang, Peng Zhang, Xindian Ma, Shuqin Gu, Zhan Su, Dawei Song

Theoretically, we prove that such tensor representation is a generalization of the n-gram language model.

Language Modelling Tensor Decomposition +1

Transformed $\ell_1$ Regularization for Learning Sparse Deep Neural Networks

no code implementations4 Jan 2019 Rongrong Ma, Jianyu Miao, Lingfeng Niu, Peng Zhang

To this end, we introduce a new non-convex integrated transformed $\ell_1$ regularizer to promote sparsity for DNNs, which removes both redundant connections and unnecessary neurons simultaneously.

Robust Visual Tracking using Multi-Frame Multi-Feature Joint Modeling

1 code implementation19 Nov 2018 Peng Zhang, Shujian Yu, Jiamiao Xu, Xinge You, Xiubao Jiang, Xiao-Yuan Jing, DaCheng Tao

It remains a huge challenge to design effective and efficient trackers under complex scenarios, including occlusions, illumination changes and pose variations.

Multi-Task Learning MULTI-VIEW LEARNING +2

Binarized Attributed Network Embedding

2 code implementations ICDM 2018 Hong Yang, Shirui Pan, Peng Zhang, Ling Chen, Defu Lian, Chengqi Zhang

To this end, we present a Binarized Attributed Network Embedding model (BANE for short) to learn binary node representation.

Graph Embedding Link Prediction +2

A Quantum Many-body Wave Function Inspired Language Modeling Approach

1 code implementation28 Aug 2018 Peng Zhang, Zhan Su, Lipeng Zhang, Benyou Wang, Dawei Song

The recently proposed quantum language model (QLM) aimed at a principled approach to modeling term dependency by applying the quantum probability theory.

Language Modelling Question Answering +1

An Efficient Approach to Learning Chinese Judgment Document Similarity Based on Knowledge Summarization

no code implementations6 Aug 2018 Yinglong Ma, Peng Zhang, Jiangang Ma

By utilizing domain ontologies for judgment documents, the core semantics of Chinese judgment documents is summarized based on knowledge blocks.

Semantic Similarity Semantic Textual Similarity

AutoAccel: Automated Accelerator Generation and Optimization with Composable, Parallel and Pipeline Architecture

no code implementations30 Jul 2018 Jason Cong, Peng Wei, Cody Hao Yu, Peng Zhang

Such a well-defined template is able to support efficient accelerator designs for a broad class of computation kernels, and more importantly, drastically reduce the design space.

Distributed, Parallel, and Cluster Computing Hardware Architecture

Hierarchical Bilinear Pooling for Fine-Grained Visual Recognition

1 code implementation ECCV 2018 Chaojian Yu, Xinyi Zhao, Qi Zheng, Peng Zhang, Xinge You

Fine-grained visual recognition is challenging because it highly relies on the modeling of various semantic parts and fine-grained feature learning.

Fine-Grained Visual Recognition

Diffusion Based Network Embedding

no code implementations9 May 2018 Yong Shi, Minglong Lei, Peng Zhang, Lingfeng Niu

In order to solve the limitations, we propose in this paper a network diffusion based embedding method.

Network Embedding Node Classification

The 2017 AIBIRDS Competition

no code implementations14 Mar 2018 Matthew Stephenson, Jochen Renz, Xiaoyu Ge, Peng Zhang

This paper presents an overview of the sixth AIBIRDS competition, held at the 26th International Joint Conference on Artificial Intelligence.

Tuning Streamed Applications on Intel Xeon Phi: A Machine Learning Based Approach

no code implementations8 Feb 2018 Peng Zhang, Jianbin Fang, Tao Tang, Canqun Yang, Zheng Wang

In this paper, we present an automatic approach to determine the hardware resource partition and the task granularity for any given application, targeting the Intel XeonPhi architecture.


IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models

3 code implementations30 May 2017 Jun Wang, Lantao Yu, Wei-Nan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, Dell Zhang

This paper provides a unified account of two schools of thinking in information retrieval modelling: the generative retrieval focusing on predicting relevant documents given a query, and the discriminative retrieval focusing on predicting relevancy given a query-document pair.

Document Ranking Information Retrieval +2

Temporal Feature Selection on Networked Time Series

no code implementations20 Dec 2016 Haishuai Wang, Jia Wu, Peng Zhang, Chengqi Zhang

For example, social network users are considered to be social sensors that continuously generate social signals (tweets) represented as a time series.

feature selection Time Series Analysis +1

SOM: Semantic Obviousness Metric for Image Quality Assessment

no code implementations CVPR 2015 Peng Zhang, Wengang Zhou, Lei Wu, Houqiang Li

We propose to extract two types of features, one to measure the semantic obviousness of the image and the other to discover local characteristic.

Image Quality Estimation No-Reference Image Quality Assessment

Predicting Failures of Vision Systems

no code implementations CVPR 2014 Peng Zhang, Jiuling Wang, Ali Farhadi, Martial Hebert, Devi Parikh

We show that a surprisingly straightforward and general approach, that we call ALERT, can predict the likely accuracy (or failure) of a variety of computer vision systems – semantic segmentation, vanishing point and camera parameter estimation, and image memorability prediction – on individual input images.

Semantic Segmentation Zero-Shot Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.