Search Results for author: Peng Zhang

Found 188 papers, 68 papers with code

Natural Language Processing Meets Quantum Physics: A Survey and Categorization

no code implementations EMNLP 2021 Sixuan Wu, Jian Li, Peng Zhang, Yue Zhang

Recent research has investigated quantum NLP, designing algorithms that process natural language in quantum computers, and also quantum-inspired algorithms that improve NLP performance on classical computers.

ClusterFormer: Neural Clustering Attention for Efficient and Effective Transformer

no code implementations ACL 2022 Ningning Wang, Guobing Gan, Peng Zhang, Shuai Zhang, Junqiu Wei, Qun Liu, Xin Jiang

Other sparse methods use clustering patterns to select words, but the clustering process is separate from the training process of the target task, which causes a decrease in effectiveness.

Clustering Machine Translation +4

HOSMEL: A Hot-Swappable Modularized Entity Linking Toolkit for Chinese

1 code implementation ACL 2022 Daniel Zhang-li, Jing Zhang, Jifan Yu, Xiaokang Zhang, Peng Zhang, Jie Tang, Juanzi Li

We investigate the usage of entity linking (EL)in downstream tasks and present the first modularized EL toolkit for easy task adaptation.

Entity Linking Question Answering

Joint Precoding for RIS-Assisted Wideband THz Cell-Free Massive MIMO Systems

no code implementations13 May 2024 Xin Su, Ruisi He, Peng Zhang, Bo Ai

After that, with knowledge of the optimal TDs of APs, we decouple the optimization problem into three subproblems of optimizing the baseband beamformers, RISs and TDs of RISs, respectively.

Dynamical Mode Recognition of Coupled Flame Oscillators by Supervised and Unsupervised Learning Approaches

no code implementations27 Apr 2024 Weiming Xu, Tao Yang, Peng Zhang

Combustion instability in gas turbines and rocket engines, as one of the most challenging problems in combustion research, arises from the complex interactions among flames, which are also influenced by chemical reactions, heat and mass transfer, and acoustics.

Dimensionality Reduction Dynamic Time Warping

MFORT-QA: Multi-hop Few-shot Open Rich Table Question Answering

no code implementations28 Mar 2024 Che Guan, Mengyu Huang, Peng Zhang

To address this challenge, the approach of Table Question Answering (QA) has been developed to extract the relevant information.

Few-Shot Learning Question Answering

InternLM2 Technical Report

1 code implementation26 Mar 2024 Zheng Cai, Maosong Cao, Haojiong Chen, Kai Chen, Keyu Chen, Xin Chen, Xun Chen, Zehui Chen, Zhi Chen, Pei Chu, Xiaoyi Dong, Haodong Duan, Qi Fan, Zhaoye Fei, Yang Gao, Jiaye Ge, Chenya Gu, Yuzhe Gu, Tao Gui, Aijia Guo, Qipeng Guo, Conghui He, Yingfan Hu, Ting Huang, Tao Jiang, Penglong Jiao, Zhenjiang Jin, Zhikai Lei, Jiaxing Li, Jingwen Li, Linyang Li, Shuaibin Li, Wei Li, Yining Li, Hongwei Liu, Jiangning Liu, Jiawei Hong, Kaiwen Liu, Kuikun Liu, Xiaoran Liu, Chengqi Lv, Haijun Lv, Kai Lv, Li Ma, Runyuan Ma, Zerun Ma, Wenchang Ning, Linke Ouyang, Jiantao Qiu, Yuan Qu, FuKai Shang, Yunfan Shao, Demin Song, Zifan Song, Zhihao Sui, Peng Sun, Yu Sun, Huanze Tang, Bin Wang, Guoteng Wang, Jiaqi Wang, Jiayu Wang, Rui Wang, Yudong Wang, Ziyi Wang, Xingjian Wei, Qizhen Weng, Fan Wu, Yingtong Xiong, Chao Xu, Ruiliang Xu, Hang Yan, Yirong Yan, Xiaogui Yang, Haochen Ye, Huaiyuan Ying, JIA YU, Jing Yu, Yuhang Zang, Chuyu Zhang, Li Zhang, Pan Zhang, Peng Zhang, Ruijie Zhang, Shuo Zhang, Songyang Zhang, Wenjian Zhang, Wenwei Zhang, Xingcheng Zhang, Xinyue Zhang, Hui Zhao, Qian Zhao, Xiaomeng Zhao, Fengzhe Zhou, Zaida Zhou, Jingming Zhuo, Yicheng Zou, Xipeng Qiu, Yu Qiao, Dahua Lin

The evolution of Large Language Models (LLMs) like ChatGPT and GPT-4 has sparked discussions on the advent of Artificial General Intelligence (AGI).

4k Long-Context Understanding

Refining Segmentation On-the-Fly: An Interactive Framework for Point Cloud Semantic Segmentation

no code implementations11 Mar 2024 Peng Zhang, Ting Wu, Jinsheng Sun, Weiqing Li, Zhiyong Su

This paper concentrates on an unexplored yet meaningful task, i. e., interactive point cloud semantic segmentation, which assigns high-quality semantic labels to all points in a scene with user corrective clicks.

Point Cloud Segmentation Segmentation +1

Learning Expressive And Generalizable Motion Features For Face Forgery Detection

no code implementations8 Mar 2024 Jingyi Zhang, Peng Zhang, Jingjing Wang, Di Xie, ShiLiang Pu

However, current sequence-based face forgery detection methods use general video classification networks directly, which discard the special and discriminative motion information for face manipulation detection.

Anomaly Detection Classification +1

Negating Negatives: Alignment without Human Positive Samples via Distributional Dispreference Optimization

1 code implementation6 Mar 2024 Shitong Duan, Xiaoyuan Yi, Peng Zhang, Tun Lu, Xing Xie, Ning Gu

Large language models (LLMs) have revolutionized the role of AI, yet also pose potential risks of propagating unethical content.

DiffSal: Joint Audio and Video Learning for Diffusion Saliency Prediction

no code implementations2 Mar 2024 Junwen Xiong, Peng Zhang, Tao You, Chuanyue Li, Wei Huang, Yufei zha

Audio-visual saliency prediction can draw support from diverse modality complements, but further performance enhancement is still challenged by customized architectures as well as task-specific loss functions.

Denoising Saliency Prediction

VN Network: Embedding Newly Emerging Entities with Virtual Neighbors

no code implementations21 Feb 2024 Yongquan He, Zihan Wang, Peng Zhang, Zhaopeng Tu, Zhaochun Ren

To address this issue, recent works apply the graph neural network on the existing neighbors of the unseen entities.

Knowledge Graph Completion Network Embedding

Frequency-aware Graph Signal Processing for Collaborative Filtering

no code implementations13 Feb 2024 Jiafeng Xia, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

Graph Signal Processing (GSP) based recommendation algorithms have recently attracted lots of attention due to its high efficiency.

Collaborative Filtering

APAR: LLMs Can Do Auto-Parallel Auto-Regressive Decoding

no code implementations12 Jan 2024 Mingdao Liu, Aohan Zeng, Bowen Wang, Peng Zhang, Jie Tang, Yuxiao Dong

The massive adoption of large language models (LLMs) demands efficient deployment strategies.

Re-evaluating the Memory-balanced Pipeline Parallelism: BPipe

no code implementations4 Jan 2024 Mincong Huang, Chao Wang, Chi Ma, Yineng Zhang, Peng Zhang, Lei Yu

Pipeline parallelism is an essential technique in the training of large-scale Transformer models.

Rapid Open-World Adaptation by Adaptation Principles Learning

no code implementations18 Dec 2023 Cheng Xue, Ekaterina Nikonova, Peng Zhang, Jochen Renz

This is an important characteristic of intelligent agents, as it allows them to continue to function effectively in novel or unexpected situations, but still stands as a critical challenge for deep reinforcement learning (DRL).

Heterogeneous Graph Neural Architecture Search with GPT-4

1 code implementation14 Dec 2023 Haoyuan Dong, Yang Gao, Haishuai Wang, Hong Yang, Peng Zhang

The basic idea of GHGNAS is to design a set of prompts that can guide GPT-4 toward the task of generating new heterogeneous graph neural architectures.

Neural Architecture Search

MaTe3D: Mask-guided Text-based 3D-aware Portrait Editing

no code implementations12 Dec 2023 Kangneng Zhou, Daiheng Gao, Xuan Wang, Jie Zhang, Peng Zhang, Xusen Sun, Longhao Zhang, Shiqi Yang, Bang Zhang, Liefeng Bo, Yaxing Wang, Ming-Ming Cheng

This enhances masked-based editing in local areas; second, we present a novel distillation strategy: Conditional Distillation on Geometry and Texture (CDGT).

Resilience-Assuring Hydrogen-Powered Microgrids

no code implementations7 Dec 2023 Chaofan Lin, Peng Zhang, Xiaonan Lu

Green hydrogen has shown great potential to power microgrids as a primary source, yet the operation methodology under extreme events is still an open area.

Dimensionality Reduction and Dynamical Mode Recognition of Circular Arrays of Flame Oscillators Using Deep Neural Network

no code implementations5 Dec 2023 Weiming Xu, Tao Yang, Peng Zhang

Oscillatory combustion in aero engines and modern gas turbines often has significant adverse effects on their operation, and accurately recognizing various oscillation modes is the prerequisite for understanding and controlling combustion instability.

Dimensionality Reduction

VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior

no code implementations4 Dec 2023 Xusen Sun, Longhao Zhang, Hao Zhu, Peng Zhang, Bang Zhang, Xinya Ji, Kangneng Zhou, Daiheng Gao, Liefeng Bo, Xun Cao

Audio-driven talking head generation has drawn much attention in recent years, and many efforts have been made in lip-sync, expressive facial expressions, natural head pose generation, and high video quality.

Talking Head Generation

Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation

1 code implementation28 Nov 2023 Li Hu, Xin Gao, Peng Zhang, Ke Sun, Bang Zhang, Liefeng Bo

Character Animation aims to generating character videos from still images through driving signals.

Human Still Wins over LLM: An Empirical Study of Active Learning on Domain-Specific Annotation Tasks

no code implementations16 Nov 2023 Yuxuan Lu, Bingsheng Yao, Shao Zhang, Yun Wang, Peng Zhang, Tun Lu, Toby Jia-Jun Li, Dakuo Wang

Large Language Models (LLMs) have demonstrated considerable advances, and several claims have been made about their exceeding human performance.

Active Learning

Software-Defined Virtual Synchronous Condenser

no code implementations15 Nov 2023 Zimin Jiang, Peng Zhang, Yifan Zhou, Łukasz Kocewiak, Divya Kurthakoti Chandrashekhara, Marie-Lou Picherit, Zefan Tang, Kenneth B. Bowes, Guangya Yang

Synchronous condensers (SCs) play important roles in integrating wind energy into relatively weak power grids.

A Comprehensive Summarization and Evaluation of Feature Refinement Modules for CTR Prediction

1 code implementation8 Nov 2023 Fangye Wang, Hansu Gu, Dongsheng Li, Tun Lu, Peng Zhang, Li Shang, Ning Gu

In addition, we present a new architecture of assigning independent FR modules to separate sub-networks for parallel CTR models, as opposed to the conventional method of inserting a shared FR module on top of the embedding layer.

Benchmarking Click-Through Rate Prediction

Mid-Long Term Daily Electricity Consumption Forecasting Based on Piecewise Linear Regression and Dilated Causal CNN

no code implementations23 Oct 2023 Zhou Lan, Ben Liu, Yi Feng, Danhuang Dong, Peng Zhang

This study decomposes the daily electricity consumption series into three components: trend, seasonal, and residual, and constructs a two-stage prediction method using piecewise linear regression as a filter and Dilated Causal CNN as a predictor.


MuseChat: A Conversational Music Recommendation System for Videos

no code implementations10 Oct 2023 Zhikang Dong, Bin Chen, Xiulong Liu, Pawel Polak, Peng Zhang

The reasoning module, equipped with the power of Large Language Model (Vicuna-7B) and extended to multi-modal inputs, is able to provide reasonable explanation for the recommended music.

Language Modelling Large Language Model +2

Tackling Data Bias in MUSIC-AVQA: Crafting a Balanced Dataset for Unbiased Question-Answering

1 code implementation10 Oct 2023 Xiulong Liu, Zhikang Dong, Peng Zhang

In recent years, there has been a growing emphasis on the intersection of audio, vision, and text modalities, driving forward the advancements in multimodal research.

Question Answering

Early Warning Prediction with Automatic Labeling in Epilepsy Patients

no code implementations9 Oct 2023 Peng Zhang, Ting Gao, Jin Guo, Jinqiao Duan, Sergey Nikolenko

Early warning for epilepsy patients is crucial for their safety and well-being, in particular to prevent or minimize the severity of seizures.

EEG Meta-Learning

Graph Neural Architecture Search with GPT-4

no code implementations30 Sep 2023 Haishuai Wang, Yang Gao, Xin Zheng, Peng Zhang, Hongyang Chen, Jiajun Bu, Philip S. Yu

In this paper, we integrate GPT-4 into GNAS and propose a new GPT-4 based Graph Neural Architecture Search method (GPT4GNAS for short).

Neural Architecture Search

Physics-Aware Neural Dynamic Equivalence of Power Systems

no code implementations29 Sep 2023 Qing Shen, Yifan Zhou, Qiang Zhang, Slava Maslennikov, Xiaochuan Luo, Peng Zhang

The contributions are threefold: (1) an ODE-Net-enabled NeuDyE formulation to enable a continuous-time, data-driven dynamic equivalence of power systems; (2) a physics-informed NeuDyE learning method (PI-NeuDyE) to actively control the closed-loop accuracy of NeuDyE without an additional verification module; (3) a physics-guided NeuDyE (PG-NeuDyE) to enhance the method's applicability even in the absence of analytical physics models.

Scalable Neural Dynamic Equivalence for Power Systems

no code implementations29 Sep 2023 Qing Shen, Yifan Zhou, Huanfeng Zhao, Peng Zhang, Qiang Zhang, Slava Maslenniko, Xiaochuan Luo

Traditional grid analytics are model-based, relying strongly on accurate models of power systems, especially the dynamic models of generators, controllers, loads and other dynamic components.

Physics-informed machine learning

Physics-Informed Induction Machine Modelling

no code implementations29 Sep 2023 Qing Shen, Yifan Zhou, Peng Zhang

This rapid communication devises a Neural Induction Machine (NeuIM) model, which pilots the use of physics-informed machine learning to enable AI-based electromagnetic transient simulations.

Physics-informed machine learning

3D Multiple Object Tracking on Autonomous Driving: A Literature Review

no code implementations27 Sep 2023 Peng Zhang, Xin Li, Liang He, Xin Lin

This paper undertakes a comprehensive examination, assessment, and synthesis of the research landscape in this domain, remaining attuned to the latest developments in 3D MOT while suggesting prospective avenues for future investigation.

3D Multi-Object Tracking Autonomous Driving +1

UniST: Towards Unifying Saliency Transformer for Video Saliency Prediction and Detection

no code implementations15 Sep 2023 Junwen Xiong, Peng Zhang, Chuanyue Li, Wei Huang, Yufei zha, Tao You

While many approaches have crafted task-specific training paradigms for either video saliency prediction or video salient object detection tasks, few attention has been devoted to devising a generalized saliency modeling framework that seamlessly bridges both these distinct tasks.

Decoder object-detection +4

Segment Anything Model for Brain Tumor Segmentation

no code implementations15 Sep 2023 Peng Zhang, Yaping Wang

Glioma is a prevalent brain tumor that poses a significant health risk to individuals.

Brain Tumor Segmentation Image Segmentation +2

AutoSeqRec: Autoencoder for Efficient Sequential Recommendation

1 code implementation14 Aug 2023 Sijia Liu, Jiahao Liu, Hansu Gu, Dongsheng Li, Tun Lu, Peng Zhang, Ning Gu

Sequential recommendation demonstrates the capability to recommend items by modeling the sequential behavior of users.

Collaborative Filtering Computational Efficiency +1

Towards Robust Real-Time Scene Text Detection: From Semantic to Instance Representation Learning

no code implementations14 Aug 2023 Xugong Qin, Pengyuan Lyu, Chengquan Zhang, Yu Zhou, Kun Yao, Peng Zhang, Hailun Lin, Weiping Wang

Different from existing methods which integrate multiple-granularity features or multiple outputs, we resort to the perspective of representation learning in which auxiliary tasks are utilized to enable the encoder to jointly learn robust features with the main task of per-pixel classification during optimization.

Representation Learning Scene Text Detection +1

Induction Network: Audio-Visual Modality Gap-Bridging for Self-Supervised Sound Source Localization

1 code implementation9 Aug 2023 Tianyu Liu, Peng Zhang, Wei Huang, Yufei zha, Tao You, Yanning Zhang

By decoupling the gradients of visual and audio modalities, the discriminative visual representations of sound sources can be learned with the designed Induction Vector in a bootstrap manner, which also enables the audio modality to be aligned with the visual modality consistently.

Contrastive Learning

Recommendation Unlearning via Matrix Correction

no code implementations29 Jul 2023 Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Jiongran Wu, Peng Zhang, Li Shang, Ning Gu

We conducted comprehensive experiments to validate the effectiveness of IMCorrect and the results demonstrate that IMCorrect is superior in completeness, utility, and efficiency, and is applicable in many recommendation unlearning scenarios.

Collaborative Filtering Recommendation Systems

Improving Semi-Supervised Semantic Segmentation with Dual-Level Siamese Structure Network

1 code implementation26 Jul 2023 Zhibo Tain, Xiaolin Zhang, Peng Zhang, Kun Zhan

Semi-supervised semantic segmentation (SSS) is an important task that utilizes both labeled and unlabeled data to reduce expenses on labeling training examples.

Contrastive Learning Pseudo Label +1

Entropy Neural Estimation for Graph Contrastive Learning

1 code implementation26 Jul 2023 Yixuan Ma, Xiaolin Zhang, Peng Zhang, Kun Zhan

In this paper, we theoretically illustrate that the entropy of a dataset can be approximated by maximizing the lower bound of the mutual information across different views of a graph, \ie, entropy is estimated by a neural network.

Contrastive Learning

Learning Stochastic Dynamical Systems as an Implicit Regularization with Graph Neural Networks

no code implementations12 Jul 2023 Jin Guo, Ting Gao, Yufu Lan, Peng Zhang, Sikun Yang, Jinqiao Duan

To that end, the observed randomness and spatial-correlations are captured by learning the drift and diffusion terms of the stochastic differential equation with a Gumble matrix embedding, respectively.

Time Series

FTFDNet: Learning to Detect Talking Face Video Manipulation with Tri-Modality Interaction

no code implementations8 Jul 2023 Ganglai Wang, Peng Zhang, Junwen Xiong, Feihan Yang, Wei Huang, Yufei zha

DeepFake based digital facial forgery is threatening public media security, especially when lip manipulation has been used in talking face generation, and the difficulty of fake video detection is further improved.

Face Detection Face Swapping +2

VisKoP: Visual Knowledge oriented Programming for Interactive Knowledge Base Question Answering

no code implementations6 Jul 2023 Zijun Yao, Yuanyong Chen, Xin Lv, Shulin Cao, Amy Xin, Jifan Yu, Hailong Jin, Jianjun Xu, Peng Zhang, Lei Hou, Juanzi Li

We present Visual Knowledge oriented Programming platform (VisKoP), a knowledge base question answering (KBQA) system that integrates human into the loop to edit and debug the knowledge base (KB) queries.

Knowledge Base Question Answering Program induction +2

MachMap: End-to-End Vectorized Solution for Compact HD-Map Construction

2 code implementations17 Jun 2023 Limeng Qiao, Yongchao Zheng, Peng Zhang, Wenjie Ding, Xi Qiu, Xing Wei, Chi Zhang

This report introduces the 1st place winning solution for the Autonomous Driving Challenge 2023 - Online HD-map Construction.

Autonomous Driving Decoder

GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model

1 code implementation11 Jun 2023 Shicheng Tan, Weng Lam Tam, Yuanchun Wang, Wenwen Gong, Yang Yang, Hongyin Tang, Keqing He, Jiahao Liu, Jingang Wang, Shu Zhao, Peng Zhang, Jie Tang

Currently, the reduction in the parameter scale of large-scale pre-trained language models (PLMs) through knowledge distillation has greatly facilitated their widespread deployment on various devices.

General Knowledge Knowledge Distillation +1

Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method

1 code implementation11 Jun 2023 Shicheng Tan, Weng Lam Tam, Yuanchun Wang, Wenwen Gong, Shu Zhao, Peng Zhang, Jie Tang

To address these problems, we propose a general language model distillation (GLMD) method that performs two-stage word prediction distillation and vocabulary compression, which is simple and surprisingly shows extremely strong performance.

Knowledge Distillation Language Modelling

Revisiting Acceptability Judgements

1 code implementation23 May 2023 Hai Hu, Ziyin Zhang, Weifang Huang, Jackie Yan-Ki Lai, Aini Li, Yina Patterson, Jiahui Huang, Peng Zhang, Chien-Jer Charles Lin, Rui Wang

We introduce CoLAC - Corpus of Linguistic Acceptability in Chinese, the first large-scale acceptability dataset for a non-Indo-European language.

Cross-Lingual Transfer Linguistic Acceptability

Binary stochasticity enabled highly efficient neuromorphic deep learning achieves better-than-software accuracy

no code implementations25 Apr 2023 Yang Li, Wei Wang, Ming Wang, Chunmeng Dou, Zhengyu Ma, Huihui Zhou, Peng Zhang, Nicola Lepri, Xumeng Zhang, Qing Luo, Xiaoxin Xu, Guanhua Yang, Feng Zhang, Ling Li, Daniele Ielmini, Ming Liu

We propose a binary stochastic learning algorithm that modifies all elementary neural network operations, by introducing (i) stochastic binarization of both the forwarding signals and the activation function derivatives, (ii) signed binarization of the backpropagating errors, and (iii) step-wised weight updates.


Triple Structural Information Modelling for Accurate, Explainable and Interactive Recommendation

no code implementations23 Apr 2023 Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

Specifically, TriSIM4Rec consists of 1) a dynamic ideal low-pass graph filter to dynamically mine co-occurrence information in user-item interactions, which is implemented by incremental singular value decomposition (SVD); 2) a parameter-free attention module to capture sequential information of user interactions effectively and efficiently; and 3) an item transition matrix to store the transition probabilities of item pairs.

Collaborative Filtering

A Measurement-Based Quantum-Like Language Model for Text Matching

1 code implementation Conference 2023 Wantong Zhang, Guobing Gan, Hui Gao, Peng Zhang, Wenjie Hui & Zipeng Fan

We take the word density matrix in one sentence as a set of measurement operators to measure another sentence, which is consistent with the definition of measurement operators in quantum theory and has a specific semantic interpretation.

Language Modelling Sentence +1

CASP-Net: Rethinking Video Saliency Prediction from an Audio-VisualConsistency Perceptual Perspective

no code implementations11 Mar 2023 Junwen Xiong, Ganglai Wang, Peng Zhang, Wei Huang, Yufei zha, Guangtao Zhai

Incorporating the audio stream enables Video Saliency Prediction (VSP) to imitate the selective attention mechanism of human brain.

Decoder Saliency Prediction +1

NovPhy: A Testbed for Physical Reasoning in Open-world Environments

1 code implementation3 Mar 2023 Chathura Gamage, Vimukthini Pinto, Cheng Xue, Peng Zhang, Ekaterina Nikonova, Matthew Stephenson, Jochen Renz

But is it enough to only have physical reasoning capabilities to operate in a real physical environment?

A network-based biomarkers discovery of Cold/Hot ZHENG chronic gastritis and Cold/Hot herbs of formulae

no code implementations10 Feb 2023 Boyang Wang, Pan Chen, Peng Zhang, Shao Li

And we collected 25 formulae (with traditional effects related to Cold/Hot ZHENG) for CG and corresponding 89 Cold/Hot herbs (including Warm/Cool herbs) to discover features and construct target networks of Cold/Hot herbs on the basis of network target and enrichment analysis.

Personalized Graph Signal Processing for Collaborative Filtering

no code implementations4 Feb 2023 Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

However, the interaction signal may not be sufficient to accurately characterize user interests and the low-pass filters may ignore the useful information contained in the high-frequency component of the observed signals, resulting in suboptimal accuracy.

Collaborative Filtering

ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editing

no code implementations31 Jan 2023 Bingchuan Li, Tianxiang Ma, Peng Zhang, Miao Hua, Wei Liu, Qian He, Zili Yi

Specifically, in Phase I, a W-space-oriented StyleGAN inversion network is trained and used to perform image inversion and editing, which assures the editability but sacrifices reconstruction quality.

Image Generation

Model Based Reinforcement Learning with Non-Gaussian Environment Dynamics and its Application to Portfolio Optimization

no code implementations23 Jan 2023 Huifang Huang, Ting Gao, Pengbo Li, Jin Guo, Peng Zhang, Nan Du

With the fast development of quantitative portfolio optimization in financial engineering, lots of AI-based algorithmic trading strategies have demonstrated promising results, among which reinforcement learning begins to manifest competitive advantages.

Algorithmic Trading Decision Making +5

GIPA: A General Information Propagation Algorithm for Graph Learning

1 code implementation19 Jan 2023 Houyi Li, Zhihong Chen, Zhao Li, Qinkai Zheng, Peng Zhang, Shuigeng Zhou

Specifically, the bit-wise correlation calculates the element-wise attention weight through a multi-layer perceptron (MLP) based on the dense representations of two nodes and their edge; The feature-wise correlation is based on the one-hot representations of node attribute features for feature selection.

Attribute feature selection +3

CL4CTR: A Contrastive Learning Framework for CTR Prediction

1 code implementation1 Dec 2022 Fangye Wang, Yingxu Wang, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

Many Click-Through Rate (CTR) prediction works focused on designing advanced architectures to model complex feature interactions but neglected the importance of feature representation learning, e. g., adopting a plain embedding layer for each feature, which results in sub-optimal feature representations and thus inferior CTR prediction performance.

Click-Through Rate Prediction Contrastive Learning +3

AS-PD: An Arbitrary-Size Downsampling Framework for Point Clouds

no code implementations2 Nov 2022 Peng Zhang, Ruoyin Xie, Jinsheng Sun, Weiqing Li, Zhiyong Su

Given an input point cloud of arbitrary size, we first perform a task-agnostic pre-sampling on the input point cloud to a specified sample size.

Parameter-free Dynamic Graph Embedding for Link Prediction

1 code implementation15 Oct 2022 Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

Dynamic interaction graphs have been widely adopted to model the evolution of user-item interactions over time.

Attribute Dynamic graph embedding +1

DART: Articulated Hand Model with Diverse Accessories and Rich Textures

1 code implementation14 Oct 2022 Daiheng Gao, Yuliang Xiu, Kailin Li, Lixin Yang, Feng Wang, Peng Zhang, Bang Zhang, Cewu Lu, Ping Tan

Unity GUI is also provided to generate synthetic hand data with user-defined settings, e. g., pose, camera, background, lighting, textures, and accessories.

Hand Pose Estimation Unity

Multi-Scale Wavelet Transformer for Face Forgery Detection

no code implementations8 Oct 2022 Jie Liu, Jingjing Wang, Peng Zhang, Chunmao Wang, Di Xie, ShiLiang Pu

To overcome these limitations, we propose a multi-scale wavelet transformer framework for face forgery detection.

Enhanced Secure Wireless Transmission Using IRS-aided Directional Modulation

no code implementations29 Sep 2022 Yeqing Lin, Rongen Dong, Peng Zhang, Feng Shu, Jiangzhou Wang

To reduce the computational complexity, a new method of maximizing receive power with zero-forcing constraint (Max-RP-ZFC) of only reflecting CM and no AN is proposed.

Multi-frequency PolSAR Image Fusion Classification Based on Semantic Interactive Information and Topological Structure

no code implementations5 Sep 2022 Yice Cao, Yan Wu, Ming Li, Mingjie Zheng, Peng Zhang, Jili Wang

Finally, an adaptive weighting fusion (AWF) strategy is proposed to merge inference from different bands, so as to make the MF joint classification decisions of SIC and TPC.

Classification Image Classification +1

Neuro-Dynamic State Estimation for Networked Microgrids

no code implementations25 Aug 2022 Fei Feng, Yifan Zhou, Peng Zhang

We devise neuro-dynamic state estimation (Neuro-DSE), a learning-based dynamic state estimation (DSE) algorithm for networked microgrids (NMs) under unknown subsystems.

AMinerGNN: Heterogeneous Graph Neural Network for Paper Click-through Rate Prediction with Fusion Query

no code implementations15 Aug 2022 Zepeng Huai, Zhe Wang, Yifan Zhu, Peng Zhang

Paper recommendation with user-generated keyword is to suggest papers that simultaneously meet user's interests and are relevant to the input keyword.

Click-Through Rate Prediction Graph Representation Learning +1

Measuring Difficulty of Novelty Reaction

no code implementations28 Jul 2022 Ekaterina Nikonova, Cheng Xue, Vimukthini Pinto, Chathura Gamage, Peng Zhang, Jochen Renz

In this paper, we propose to define the novelty reaction difficulty as a relative difficulty of performing the known task after the introduction of the novelty.

Subgraph Neighboring Relations Infomax for Inductive Link Prediction on Knowledge Graphs

1 code implementation28 Jul 2022 Xiaohan Xu, Peng Zhang, Yongquan He, Chengpeng Chao, Chaoyang Yan

Inductive link prediction for knowledge graph aims at predicting missing links between unseen entities, those not shown in training stage.

Inductive Link Prediction Knowledge Graphs

TRIE++: Towards End-to-End Information Extraction from Visually Rich Documents

no code implementations14 Jul 2022 Zhanzhan Cheng, Peng Zhang, Can Li, Qiao Liang, Yunlu Xu, Pengfei Li, ShiLiang Pu, Yi Niu, Fei Wu

Most existing methods divide this task into two subparts: the text reading part for obtaining the plain text from the original document images and the information extraction part for extracting key contents.

Language Modelling

A Framework Based on Generational and Environmental Response Strategies for Dynamic Multi-objective Optimization

no code implementations6 Jul 2022 Qingya Li, Xiangzhi Liu, Fuqiang Wang, Shuai Wang, Peng Zhang, Xiaoming Wu

In this paper, a novel framework based on generational and environmental response strategies (FGERS) is proposed, in which response strategies are run both in the environmental change stage and the environmental static stage to obtain population evolution information of those both stages.

Measurement of carbon finance level and exploration of its influencing factors

no code implementations1 Jun 2022 Peng Zhang, Yuwei Zhang, Nuo Xu

Faced with increasingly severe environmental problems, carbon trading markets and related financial activities aiming at limiting carbon dioxide emissions are booming.

Resilience in Industrial Internet of Things Systems: A Communication Perspective

no code implementations1 Jun 2022 Hao Wu, Yifan Miao, Peng Zhang, Yang Tian, Hui Tian

Industrial Internet of Things is an ultra-large-scale system that is much more sophisticated and fragile than conventional industrial platforms.


Stock Trading Optimization through Model-based Reinforcement Learning with Resistance Support Relative Strength

no code implementations30 May 2022 Huifang Huang, Ting Gao, Yi Gui, Jin Guo, Peng Zhang

Reinforcement learning (RL) is gaining attention by more and more researchers in quantitative finance as the agent-environment interaction framework is aligned with decision making process in many business problems.

Decision Making Model-based Reinforcement Learning +2

AI-aided multiscale modeling of physiologically-significant blood clots

no code implementations25 May 2022 Yicong Zhu, Changnian Han, Peng Zhang, Guojing Cong, James R. Kozloski, Chih-Chieh Yang, Leili Zhang, Yuefan Deng

We have developed an AI-aided multiple time stepping (AI-MTS) algorithm and multiscale modeling framework (AI-MSM) and implemented them on the Summit-like supercomputer, AIMOS.

Rapid Phase Ambiguity Elimination Methods for DOA Estimator via Hybrid Massive MIMO Receive Array

no code implementations27 Apr 2022 Xichao Zhan, YiWen Chen, Feng Shu, Xin Cheng, Yuanyuan Wu, Qi Zhang, Yifang Li, Peng Zhang

In the proposed Max-RP-QI, a quadratic interpolation scheme is adopted to interpolate the three DOA values corresponding to the largest three receive powers of Max-RP.

Enhancing CTR Prediction with Context-Aware Feature Representation Learning

1 code implementation19 Apr 2022 Fangye Wang, Yingxu Wang, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

However, most methods only learn a fixed representation for each feature without considering the varying importance of each feature under different contexts, resulting in inferior performance.

Click-Through Rate Prediction Representation Learning

A Multi-Metric Latent Factor Model for Analyzing High-Dimensional and Sparse data

no code implementations16 Apr 2022 Di wu, Peng Zhang, Yi He, Xin Luo

High-dimensional and sparse (HiDS) matrices are omnipresent in a variety of big data-related applications.

Representation Learning

Personalized Image Aesthetics Assessment with Rich Attributes

no code implementations CVPR 2022 Yuzhe Yang, Liwu Xu, Leida Li, Nan Qie, Yaqian Li, Peng Zhang, Yandong Guo

To solve the dilemma, we conduct so far, the most comprehensive subjective study of personalized image aesthetics and introduce a new Personalized image Aesthetics database with Rich Attributes (PARA), which consists of 31, 220 images with annotations by 438 subjects.

An Audio-Visual Attention Based Multimodal Network for Fake Talking Face Videos Detection

no code implementations10 Mar 2022 Ganglai Wang, Peng Zhang, Lei Xie, Wei Huang, Yufei zha, Yanning Zhang

DeepFake based digital facial forgery is threatening the public media security, especially when lip manipulation has been used in talking face generation, the difficulty of fake video detection is further improved.

Decision Making Face Detection +2

Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wild

no code implementations8 Mar 2022 Ganglai Wang, Peng Zhang, Lei Xie, Wei Huang, Yufei zha

Rather than focusing on the unimportant regions of the face image, the proposed AttnWav2Lip model is able to pay more attention on the lip region reconstruction.

Talking Face Generation

Audio-visual speech separation based on joint feature representation with cross-modal attention

no code implementations5 Mar 2022 Junwen Xiong, Peng Zhang, Lei Xie, Wei Huang, Yufei zha, Yanning Zhang

Multi-modal based speech separation has exhibited a specific advantage on isolating the target character in multi-talker noisy environments.

Optical Flow Estimation Speech Separation

Look\&Listen: Multi-Modal Correlation Learning for Active Speaker Detection and Speech Enhancement

1 code implementation4 Mar 2022 Junwen Xiong, Yu Zhou, Peng Zhang, Lei Xie, Wei Huang, Yufei zha

Active speaker detection and speech enhancement have become two increasingly attractive topics in audio-visual scenario understanding.

Multi-Task Learning Speech Enhancement

Absolute Zero-Shot Learning

no code implementations23 Feb 2022 Rui Gao, Fan Wan, Daniel Organisciak, Jiyao Pu, Junyan Wang, Haoran Duan, Peng Zhang, Xingsong Hou, Yang Long

Considering the increasing concerns about data copyright and privacy issues, we present a novel Absolute Zero-Shot Learning (AZSL) paradigm, i. e., training a classifier with zero real data.

Transfer Learning Zero-Shot Learning

Learning Multiple Explainable and Generalizable Cues for Face Anti-spoofing

no code implementations21 Feb 2022 Ying Bian, Peng Zhang, Jingjing Wang, Chunmao Wang, ShiLiang Pu

However, many other generalizable cues are unexplored for face anti-spoofing, which limits their performance under cross-dataset testing.

Face Anti-Spoofing

AD-NEGF: An End-to-End Differentiable Quantum Transport Simulator for Sensitivity Analysis and Inverse Problems

no code implementations10 Feb 2022 Yingzhanghao Zhou, Xiang Chen, Peng Zhang, Jun Wang, Lei Wang, Hong Guo

Since proposed in the 70s, the Non-Equilibrium Green Function (NEGF) method has been recognized as a standard approach to quantum transport simulations.

Signal Shaping for Semantic Communication Systems with A Few Message Candidates

no code implementations4 Feb 2022 Shuaishuai Guo, Yanhu Wang, Peng Zhang

Semantic communications target to reliably convey the semantic meaning of messages.

Automated assessment of disease severity of COVID-19 using artificial intelligence with synthetic chest CT

no code implementations11 Dec 2021 Mengqiu Liu, Ying Liu, Yidong Yang, Aiping Liu, Shana Li, Changbing Qu, Xiaohui Qiu, Yang Li, Weifu Lv, Peng Zhang, Jie Wen

Correlations between imaging findings and clinical lab tests suggested the value of this system as a potential tool to assess disease severity of COVID-19.

Data Augmentation Lesion Segmentation

Modeling Variable Space with Residual Tensor Networks for Multivariate Time Series

no code implementations29 Sep 2021 Jing Zhang, Peng Zhang, Yupeng He, Siwei Rao, Jun Wang, Guangjian Tian

In this framework, we derive the mathematical representation of the variable space, and then use a tensor network based on the idea of low-rank approximation to model the variable space.

Multivariate Time Series Forecasting Tensor Networks +2

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

1 code implementation22 Sep 2021 Bingchuan Li, Shaofei Cai, Wei Liu, Peng Zhang, Qian He, Miao Hua, Zili Yi

To address these limitations, we design a Dynamic Style Manipulation Network (DyStyle) whose structure and parameters vary by input samples, to perform nonlinear and adaptive manipulation of latent codes for flexible and precise attribute control.

Attribute Contrastive Learning

Phy-Q as a measure for physical reasoning intelligence

1 code implementation31 Aug 2021 Cheng Xue, Vimukthini Pinto, Chathura Gamage, Ekaterina Nikonova, Peng Zhang, Jochen Renz

Inspired by how human IQ is calculated, we define the physical reasoning quotient (Phy-Q score) that reflects the physical reasoning intelligence of an agent using the physical scenarios we considered.

Graph Contrastive Learning for Anomaly Detection

2 code implementations17 Aug 2021 Bo Chen, Jing Zhang, Xiaokang Zhang, Yuxiao Dong, Jian Song, Peng Zhang, Kaibo Xu, Evgeny Kharlamov, Jie Tang

To achieve the contrastive objective, we design a graph neural network encoder that can infer and further remove suspicious links during message passing, as well as learn the global context of the input graph.

Anomaly Detection Binary Classification +2

Unsupervised Cross-Modal Distillation for Thermal Infrared Tracking

1 code implementation31 Jul 2021 Jingxian Sun, Lichao Zhang, Yufei zha, Abel Gonzalez-Garcia, Peng Zhang, Wei Huang, Yanning Zhang

To solve this problem, we propose to distill representations of the TIR modality from the RGB modality with Cross-Modal Distillation (CMD) on a large amount of unlabeled paired RGB-TIR data.

Transfer Learning

Hi-Phy: A Benchmark for Hierarchical Physical Reasoning

1 code implementation17 Jun 2021 Cheng Xue, Vimukthini Pinto, Chathura Gamage, Peng Zhang, Jochen Renz

In this paper, we propose a new benchmark for physical reasoning that allows us to test individual physical reasoning capabilities.

WASE: Learning When to Attend for Speaker Extraction in Cocktail Party Environments

1 code implementation13 Jun 2021 Yunzhe Hao, Jiaming Xu, Peng Zhang, Bo Xu

In the speaker extraction problem, it is found that additional information from the target speaker contributes to the tracking and extraction of the target speaker, which includes voiceprint, lip movement, facial expression, and spatial information.

Action Detection Activity Detection

Path-based Deep Network for Candidate Item Matching in Recommenders

no code implementations18 May 2021 Houyi Li, Zhihong Chen, Chenliang Li, Rong Xiao, Hongbo Deng, Peng Zhang, Yongchao Liu, Haihong Tang

PDN utilizes Trigger Net to capture the user's interest in each of his/her interacted item, and Similarity Net to evaluate the similarity between each interacted item and the target item based on these items' profile and CF information.

Recommendation Systems Retrieval

GIPA: General Information Propagation Algorithm for Graph Learning

2 code implementations13 May 2021 Qinkai Zheng, Houyi Li, Peng Zhang, Zhixiong Yang, Guowei Zhang, Xintan Zeng, Yongchao Liu

Graph neural networks (GNNs) have been popularly used in analyzing graph-structured data, showing promising results in various applications such as node classification, link prediction and network recommendation.

Graph Attention Graph Learning +2

VSR: A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relations

1 code implementation13 May 2021 Peng Zhang, Can Li, Liang Qiao, Zhanzhan Cheng, ShiLiang Pu, Yi Niu, Fei Wu

To address the above limitations, we propose a unified framework VSR for document layout analysis, combining vision, semantics and relations.

Document Layout Analysis Relation

LGPMA: Complicated Table Structure Recognition with Local and Global Pyramid Mask Alignment

1 code implementation13 May 2021 Liang Qiao, Zaisheng Li, Zhanzhan Cheng, Peng Zhang, ShiLiang Pu, Yi Niu, Wenqi Ren, Wenming Tan, Fei Wu

In this paper, we aim to obtain more reliable aligned bounding boxes by fully utilizing the visual information from both text regions in proposed local features and cell relations in global features.

Table Recognition

A Feature Fusion-Net Using Deep Spatial Context Encoder and Nonstationary Joint Statistical Model for High Resolution SAR Image Classification

no code implementations11 May 2021 Wenkai Liang, Yan Wu, Ming Li, Peng Zhang, Yice Cao, Xin Hu

To address this problem, a novel end-to-end supervised classification method is proposed for HR SAR images by considering both spatial context and statistical features.

Image Classification

GraphTheta: A Distributed Graph Neural Network Learning System With Flexible Training Strategy

1 code implementation21 Apr 2021 Yongchao Liu, Houyi Li, Guowei Zhang, Xintan Zeng, Yongyong Li, Bin Huang, Peng Zhang, Zhao Li, Xiaowei Zhu, Changhua He, WenGuang Chen

Herein, we present GraphTheta, the first distributed and scalable graph learning system built upon vertex-centric distributed graph processing with neural network operators implemented as user-defined functions.

Graph Learning

Noise-Resilient Quantum Machine Learning for Stability Assessment of Power Systems

no code implementations10 Apr 2021 Yifan Zhou, Peng Zhang

Transient stability assessment (TSA) is a cornerstone for resilient operations of today's interconnected power grids.

BIG-bench Machine Learning Quantum Machine Learning

A review of artificial intelligence methods combined with Raman spectroscopy to identify the composition of substances

no code implementations5 Apr 2021 Liangrui Pan, Peng Zhang, Chalongrat Daengngam, Mitchai Chongcheawchamnan

This review summarizes the work of Raman spectroscopy in identifying the composition of substances and reviews the preprocessing process of Raman spectroscopy, the analysis methods and applications of artificial intelligence.

OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services

1 code implementation3 Mar 2021 Xiao Liu, Da Yin, Jingnan Zheng, Xingjian Zhang, Peng Zhang, Hongxia Yang, Yuxiao Dong, Jie Tang

Academic knowledge services have substantially facilitated the development of the science enterprise by providing a plenitude of efficient research tools.

Language Modelling Link Prediction

CogDL: A Comprehensive Library for Graph Deep Learning

1 code implementation1 Mar 2021 Yukuo Cen, Zhenyu Hou, Yan Wang, Qibin Chen, Yizhen Luo, Zhongming Yu, Hengrui Zhang, Xingcheng Yao, Aohan Zeng, Shiguang Guo, Yuxiao Dong, Yang Yang, Peng Zhang, Guohao Dai, Yu Wang, Chang Zhou, Hongxia Yang, Jie Tang

In CogDL, we propose a unified design for the training and evaluation of GNN models for various graph tasks, making it unique among existing graph learning libraries.

Graph Classification Graph Embedding +5

D2A U-Net: Automatic Segmentation of COVID-19 Lesions from CT Slices with Dilated Convolution and Dual Attention Mechanism

1 code implementation10 Feb 2021 Xiangyu Zhao, Peng Zhang, Fan Song, Guangda Fan, Yangyang Sun, Yujia Wang, Zheyuan Tian, Luqi Zhang, Guanglei Zhang

In this paper we propose a dilated dual attention U-Net (D2A U-Net) for COVID-19 lesion segmentation in CT slices based on dilated convolution and a novel dual attention mechanism to address the issues above.

Computed Tomography (CT) Decoder +3

Neuro-Reachability of Networked Microgrids

no code implementations13 Jan 2021 Yifan Zhou, Peng Zhang

A neural ordinary differential equations network (ODE-Net)-enabled reachability method (Neuro-Reachability) is devised for the dynamic verification of networked microgrids (NMs) with unidentified subsystems and heterogeneous uncertainties.

Model Discovery

TextTN: Probabilistic Encoding of Language on Tensor Network

no code implementations1 Jan 2021 Peng Zhang, Jing Zhang, Xindian Ma, Siwei Rao, Guangjian Tian, Jun Wang

As a novel model that bridges machine learning and quantum theory, tensor network (TN) has recently gained increasing attention and successful applications for processing natural images.

General Classification Sentence +4

Fluctuations in crystalline plasticity

no code implementations23 Dec 2020 Jérôme Weiss, Peng Zhang, Oguz Umut Salman, Gang Liu, Lev Truskinovsky

We link this new size effect with other related phenomena like size dependence of strength ("smaller is stronger") and the size induced switch between different hardening mechanisms.

Mesoscale and Nanoscale Physics Materials Science Statistical Mechanics Computational Physics

Residual Matrix Product State for Machine Learning

no code implementations22 Dec 2020 Ye-Ming Meng, Jing Zhang, Peng Zhang, Chao GAO, Shi-Ju Ran

Tensor network, which originates from quantum physics, is emerging as an efficient tool for classical and quantum machine learning.

BIG-bench Machine Learning Quantum Machine Learning +1

A New Many-Objective Evolutionary Algorithm Based on Determinantal Point Processes

no code implementations15 Dec 2020 Peng Zhang, Jinlong Li, Tengfei Li, Huanhuan Chen

To handle different types of Many-Objective Optimization Problems (MaOPs), Many-Objective Evolutionary Algorithms (MaOEAs) need to simultaneously maintain convergence and population diversity in the high-dimensional objective space.

Evolutionary Algorithms Point Processes

CODE: Contrastive Pre-training with Adversarial Fine-tuning for Zero-shot Expert Linking

2 code implementations14 Dec 2020 Bo Chen, Jing Zhang, Xiaokang Zhang, Xiaobin Tang, Lingfan Cai, Hong Chen, Cuiping Li, Peng Zhang, Jie Tang

In this paper, we propose CODE, which first pre-trains an expert linking model by contrastive learning on AMiner such that it can capture the representation and matching patterns of experts without supervised signals, then it is fine-tuned between AMiner and external sources to enhance the models transferability in an adversarial manner.

Active Learning Contrastive Learning +2

Audio-visual Speech Separation with Adversarially Disentangled Visual Representation

no code implementations29 Nov 2020 Peng Zhang, Jiaming Xu, Jing Shi, Yunzhe Hao, Bo Xu

In our model, we use the face detector to detect the number of speakers in the scene and use visual information to avoid the permutation problem.

Speech Separation

Nonlinear Cooperative Control of Double Drone-Bar Transportation System

no code implementations15 Nov 2020 Peng Zhang, Yongchun Fang, Xiao Liang, He Lin, wei he

Due to the limitation of the drone's load capacity, various specific tasks need to be accomplished by multiple drones in collaboration.

Dynamical Systems Systems and Control Systems and Control

Noise Reduction Technique for Raman Spectrum using Deep Learning Network

no code implementations9 Sep 2020 Liangrui Pan, Pronthep Pipitsunthonsan, Peng Zhang, Chalongrat Daengngam, Apidach Booranawong, Mitcham Chongcheawchamnan

It is shown that output SNR of the proposed noise reduction technology is 10. 24 dB greater than that of the wavelet noise reduction method while the RMSE and the MAPE are 292. 63 and 10. 09, which are much better than the proposed technique.

TensorCoder: Dimension-Wise Attention via Tensor Representation for Natural Language Modeling

no code implementations28 Jul 2020 Shuai Zhang, Peng Zhang, Xindian Ma, Junqiu Wei, Ningning Wang, Qun Liu

Transformer has been widely-used in many Natural Language Processing (NLP) tasks and the scaled dot-product attention between tokens is a core module of Transformer.

Language Modelling Machine Translation +2

Signal Shaping for Non-Uniform Beamspace Modulated mmWave Hybrid MIMO Communications

no code implementations23 Jun 2020 Shuaishuai Guo, Haixia Zhang, Peng Zhang, Shuping Zhang, Chengcheng Xu, Mohamed-Slim Alouini

Specifically, we firstly propose a joint optimization based signal shaping (JOSS) approach, in which the symbol vector sets used for all analog precoder activation states are jointly optimized by solving a series of quadratically constrained quadratic programming (QCQP) problems.

TRIE: End-to-End Text Reading and Information Extraction for Document Understanding

1 code implementation27 May 2020 Peng Zhang, Yunlu Xu, Zhanzhan Cheng, ShiLiang Pu, Jing Lu, Liang Qiao, Yi Niu, Fei Wu

Since real-world ubiquitous documents (e. g., invoices, tickets, resumes and leaflets) contain rich information, automatic document image understanding has become a hot topic.

document understanding

Revisiting Regex Generation for Modeling Industrial Applications by Incorporating Byte Pair Encoder

no code implementations6 May 2020 De-Sheng Wang, Jiawei Liu, Xiang Qi, Baolin Sun, Peng Zhang

The results demonstrate the effectiveness of our method, which outperforms the baseline on 10 kinds of data and achieves nearly 50 percent improvement on average.

Deep Reinforcement Learning (DRL): Another Perspective for Unsupervised Wireless Localization

no code implementations9 Apr 2020 You Li, Xin Hu, Yuan Zhuang, Zhouzheng Gao, Peng Zhang, Naser El-Sheimy

However, it is challenging to use low-cost IoT devices for robust unsupervised localization (i. e., localization without training data that have known location labels).

reinforcement-learning Reinforcement Learning (RL)

Optimizing Streaming Parallelism on Heterogeneous Many-Core Architectures: A Machine Learning Based Approach

1 code implementation5 Mar 2020 Peng Zhang, Jianbin Fang, Canqun Yang, Chun Huang, Tao Tang, Zheng Wang

This article presents an automatic approach to quickly derive a good solution for hardware resource partition and task granularity for task-based parallel applications on heterogeneous many-core architectures.

BIG-bench Machine Learning

KoGuN: Accelerating Deep Reinforcement Learning via Integrating Human Suboptimal Knowledge

no code implementations18 Feb 2020 Peng Zhang, Jianye Hao, Weixun Wang, Hongyao Tang, Yi Ma, Yihai Duan, Yan Zheng

Our framework consists of a fuzzy rule controller to represent human knowledge and a refine module to fine-tune suboptimal prior knowledge.

Common Sense Reasoning Continuous Control +2

Encoding word order in complex embeddings

1 code implementation ICLR 2020 Benyou Wang, Donghao Zhao, Christina Lioma, Qiuchi Li, Peng Zhang, Jakob Grue Simonsen

The benefit of continuous functions over variable positions is that word representations shift smoothly with increasing positions.

Language Modelling Machine Translation +5

Reflecting Modulation

no code implementations18 Dec 2019 Shuaishuai Guo, Shuheng Lv, Haixia Zhang, Jia Ye, Peng Zhang

This paper proposes a reflecting modulation (RM) scheme for RIS-based communications, where both the reflecting patterns and transmit signals can carry information.

Kernelized Similarity Learning and Embedding for Dynamic Texture Synthesis

1 code implementation11 Nov 2019 Shiming Chen, Peng Zhang, Guo-Sen Xie, Qinmu Peng, Zehong Cao, Wei Yuan, Xinge You

Dynamic texture (DT) exhibits statistical stationarity in the spatial domain and stochastic repetitiveness in the temporal dimension, indicating that different frames of DT possess a high similarity correlation that is critical prior knowledge.

Texture Synthesis

Balancing Covariates in Randomized Experiments with the Gram-Schmidt Walk Design

1 code implementation8 Nov 2019 Christopher Harshaw, Fredrik Sävje, Daniel Spielman, Peng Zhang

Asymptotically, the design perfectly balances all linear functions of a growing number of covariates with a diminishing reduction in robustness, effectively allowing experimenters to escape the compromise between balance and robustness in large samples.

Methodology Data Structures and Algorithms Statistics Theory Statistics Theory

Leveraging Entanglement Entropy for Deep Understanding of Attention Matrix in Text Matching

no code implementations25 Sep 2019 Peng Zhang, Xiaoliu Mao, Xindian Ma, Benyou Wang, Jing Zhang, Jun Wang, Dawei Song

We prove that by a mapping (via the trace operator) on the high-dimensional matching matrix, a low-dimensional attention matrix can be derived.

Inductive Bias Question Answering +2

Interpretable Network Structure for Modeling Contextual Dependency

no code implementations25 Sep 2019 Xindian Ma, Peng Zhang, Xiaoliu Mao, Yehua Zhang, Nan Duan, Yuexian Hou, Ming Zhou.

Then, we show that the lower bound of such a separation rank can reveal the quantitative relation between the network structure (e. g. depth/width) and the modeling ability for the contextual dependency.

Language Modelling Sentence +1

CASA-NLU: Context-Aware Self-Attentive Natural Language Understanding for Task-Oriented Chatbots

no code implementations IJCNLP 2019 Arshit Gupta, Peng Zhang, Garima Lalwani, Mona Diab

In this work, we propose a context-aware self-attentive NLU (CASA-NLU) model that uses multiple signals, such as previous intents, slots, dialog acts and utterances over a variable context window, in addition to the current user utterance.

Dialogue Management intent-classification +3

MarlRank: Multi-agent Reinforced Learning to Rank

no code implementations15 Sep 2019 Shihao Zou, Zhonghua Li, Mohammad Akbari, Jun Wang, Peng Zhang

By defining reward as a function of NDCG, we can optimize our model directly on the ranking performance measure.

Document Ranking Learning-To-Rank

Explainable Video Action Reasoning via Prior Knowledge and State Transitions

1 code implementation28 Aug 2019 Tao Zhuo, Zhiyong Cheng, Peng Zhang, Yongkang Wong, Mohan Kankanhalli

Finally, by sequentially examining each state transition in the video graph, our method can detect and explain how those actions are executed with prior knowledge, just like the logical manner of thinking by humans.

Action Analysis Attribute