Search Results for author: Jun Zhao

Found 264 papers, 62 papers with code

How to Generate a Good Word Embedding?

2 code implementations20 Jul 2015 Siwei Lai, Kang Liu, Liheng Xu, Jun Zhao

We analyze three critical components of word embedding training: the model, the corpus, and the training parameters.

Word Embeddings

Convolutional Neural Networks for Text Hashing

no code implementations IJCAI 2015 Jiaming Xu, PengWang, Guanhua Tian, Bo Xu, Jun Zhao, Fangyuan Wang, HongWei Hao

Meanwhile word features and position features are together fed into a convolutional network to learn the implicit features which are further incorporated with the explicit features to fit the pretrained binary code.

Question Answering over Knowledge Base with Neural Attention Combining Global Knowledge Information

no code implementations3 Jun 2016 Yuanzhe Zhang, Kang Liu, Shizhu He, Guoliang Ji, Zhanyi Liu, Hua Wu, Jun Zhao

With the rapid growth of knowledge bases (KBs) on the web, how to take full advantage of them becomes increasingly important.

Question Answering

Removal of Batch Effects using Distribution-Matching Residual Networks

1 code implementation13 Oct 2016 Uri Shaham, Kelly P. Stanton, Jun Zhao, Huamin Li, Khadir Raddassi, Ruth Montgomery, Yuval Kluger

We apply our method to mass cytometry and single-cell RNA-seq datasets, and demonstrate that it effectively attenuates batch effects.

Which is the Effective Way for Gaokao: Information Retrieval or Neural Networks?

1 code implementation EACL 2017 Shangmin Guo, Xiangrong Zeng, Shizhu He, Kang Liu, Jun Zhao

As one of the most important test of China, Gaokao is designed to be difficult enough to distinguish the excellent high school students.

Information Retrieval Multiple-choice +4

Generating Natural Answers by Incorporating Copying and Retrieving Mechanisms in Sequence-to-Sequence Learning

no code implementations ACL 2017 Shizhu He, Cao Liu, Kang Liu, Jun Zhao

Generating answer with natural language sentence is very important in real-world question answering systems, which needs to obtain a right answer as well as a coherent natural response.

Question Answering Sentence

IJCNLP-2017 Task 5: Multi-choice Question Answering in Examinations

no code implementations IJCNLP 2017 Shangmin Guo, Kang Liu, Shizhu He, Cao Liu, Jun Zhao, Zhuoyu Wei

The IJCNLP-2017 Multi-choice Question Answering(MCQA) task aims at exploring the performance of current Question Answering(QA) techniques via the realworld complex questions collected from Chinese Senior High School Entrance Examination papers and CK12 website1.

Question Answering

Loss Rank Mining: A General Hard Example Mining Method for Real-time Detectors

no code implementations10 Apr 2018 Hao Yu, Zhaoning Zhang, Zheng Qin, Hao Wu, Dongsheng Li, Jun Zhao, Xicheng Lu

LRM is a general method for real-time detectors, as it utilizes the final feature map which exists in all real-time detectors to mine hard examples.

Towards Practical Visual Search Engine within Elasticsearch

no code implementations23 Jun 2018 Cun Mu, Jun Zhao, Guang Yang, Jing Zhang, Zheng Yan

In this paper, we describe our end-to-end content-based image retrieval system built upon Elasticsearch, a well-known and popular textual search engine.

Content-Based Image Retrieval Retrieval

Pattern-revising Enhanced Simple Question Answering over Knowledge Bases

no code implementations COLING 2018 Yanchao Hao, Hao liu, Shizhu He, Kang Liu, Jun Zhao

Question Answering over Knowledge Bases (KB-QA), which automatically answer natural language questions based on the facts contained by a knowledge base, is one of the most important natural language processing (NLP) tasks.

Entity Linking Fact Selection +2

Event Detection via Gated Multilingual Attention Mechanism

no code implementations AAAI-18 2018 Jian Liu, Yubo Chen, Kang Liu, Jun Zhao

In specific, to alleviate data scarcity problem, we exploit the consistent information in multilingual data via context attention mechanism.

Event Detection

Collective Event Detection via a Hierarchical and Bias Tagging Networks with Gated Multi-level Attention Mechanisms

1 code implementation EMNLP 2018 Yubo Chen, Hang Yang, Kang Liu, Jun Zhao, Yantao Jia

Traditional approaches to the task of ACE event detection primarily regard multiple events in one sentence as independent ones and recognize them separately by using sentence-level information.

Event Detection Sentence

Fast and Exact Nearest Neighbor Search in Hamming Space on Full-Text Search Engines

no code implementations20 Feb 2019 Cun Mu, Jun Zhao, Guang Yang, Binwei Yang, Zheng Yan

A growing interest has been witnessed recently from both academia and industry in building nearest neighbor search (NNS) solutions on top of full-text search engines.

Information Retrieval Representation Learning +1

Privacy-preserving Crowd-guided AI Decision-making in Ethical Dilemmas

no code implementations4 Jun 2019 Teng Wang, Jun Zhao, Han Yu, Jinyan Liu, Xinyu Yang, Xuebin Ren, Shuyu Shi

To investigate such ethical dilemmas, recent studies have adopted preference aggregation, in which each voter expresses her/his preferences over decisions for the possible ethical dilemma scenarios, and a centralized system aggregates these preferences to obtain the winning decision.

Autonomous Vehicles Decision Making +1

Privacy-Preserving Blockchain-Based Federated Learning for IoT Devices

no code implementations26 Jun 2019 Yang Zhao, Jun Zhao, Linshan Jiang, Rui Tan, Dusit Niyato, Zengxiang Li, Lingjuan Lyu, Yingbo Liu

To help manufacturers develop a smart home system, we design a federated learning (FL) system leveraging the reputation mechanism to assist home appliance manufacturers to train a machine learning model based on customers' data.

Edge-computing Federated Learning +1

Collecting and Analyzing Multidimensional Data with Local Differential Privacy

no code implementations28 Jun 2019 Ning Wang, Xiaokui Xiao, Yin Yang, Jun Zhao, Siu Cheung Hui, Hyejin Shin, Junbum Shin, Ge Yu

Motivated by this, we first propose novel LDP mechanisms for collecting a numeric attribute, whose accuracy is at least no worse (and usually better) than existing solutions in terms of worst-case noise variance.

Attribute

Vocabulary Pyramid Network: Multi-Pass Encoding and Decoding with Multi-Level Vocabularies for Response Generation

no code implementations ACL 2019 Cao Liu, Shizhu He, Kang Liu, Jun Zhao

To tackle the above two problems, we present a Vocabulary Pyramid Network (VPN) which is able to incorporate multi-pass encoding and decoding with multi-level vocabularies into response generation.

Clustering Response Generation

AdaNSP: Uncertainty-driven Adaptive Decoding in Neural Semantic Parsing

no code implementations ACL 2019 Xiang Zhang, Shizhu He, Kang Liu, Jun Zhao

To keep the model aware of the underlying grammar in target sequences, many constrained decoders were devised in a multi-stage paradigm, which decode to the sketches or abstract syntax trees first, and then decode to target semantic tokens.

Semantic Parsing Sentence

IntentGC: a Scalable Graph Convolution Framework Fusing Heterogeneous Information for Recommendation

1 code implementation24 Jul 2019 Jun Zhao, Zhou Zhou, Ziyu Guan, Wei Zhao, Wei Ning, Guang Qiu, Xiaofei He

In this work, we collect abundant relationships from common user behaviors and item information, and propose a novel framework named IntentGC to leverage both explicit preferences and heterogeneous relationships by graph convolutional networks.

Network Embedding

Copy-Enhanced Heterogeneous Information Learning for Dialogue State Tracking

no code implementations21 Aug 2019 Qingbin Liu, Shizhu He, Kang Liu, Shengping Liu, Jun Zhao

How to integrate the semantic information of pre-defined ontology and dialogue text (heterogeneous texts) to generate unknown values and improve performance becomes a severe challenge.

Dialogue State Tracking Task-Oriented Dialogue Systems

A Survey of Simultaneous Localization and Mapping

no code implementations24 Aug 2019 Baichuan Huang, Jun Zhao, Jingbin Liu

The paper makes an overview in SLAM including Lidar SLAM, visual SLAM, and their fusion.

Robotics Simultaneous Localization and Mapping

Resource Allocation in Mobility-Aware Federated Learning Networks: A Deep Reinforcement Learning Approach

no code implementations21 Oct 2019 Huy T. Nguyen, Nguyen Cong Luong, Jun Zhao, Chau Yuen, Dusit Niyato

However, federated learning faces the energy constraints of the workers and the high network resource cost due to the fact that a number of global model transmissions may be required to achieve the target accuracy.

Federated Learning Reinforcement Learning (RL)

Incorporating Interlocutor-Aware Context into Response Generation on Multi-Party Chatbots

no code implementations CONLL 2019 Cao Liu, Kang Liu, Shizhu He, Zaiqing Nie, Jun Zhao

Facing this challenge, we present a response generation model which incorporates Interlocutor-aware Contexts into Recurrent Encoder-Decoder frameworks (ICRED) for RGMPC.

Chatbot Response Generation

Adaptive Statistical Learning with Bayesian Differential Privacy

no code implementations2 Nov 2019 Jun Zhao

Our results in adaptive statistical learning generalize the results of Dwork et al. for i. i. d.

Holdout Set

Blockchain for Future Smart Grid: A Comprehensive Survey

1 code implementation8 Nov 2019 Muhammad Baqer Mollah, Jun Zhao, Dusit Niyato, Kwok-Yan Lam, Xin Zhang, Amer M. Y. M. Ghias, Leong Hai Koh, Lei Yang

In this paper, we aim to provide a comprehensive survey on application of blockchain in smart grid.

Cryptography and Security Distributed, Parallel, and Cluster Computing Networking and Internet Architecture Social and Information Networks Systems and Control Systems and Control

Reviewing and Improving the Gaussian Mechanism for Differential Privacy

no code implementations27 Nov 2019 Jun Zhao, Teng Wang, Tao Bai, Kwok-Yan Lam, Zhiying Xu, Shuyu Shi, Xuebin Ren, Xinyu Yang, Yang Liu, Han Yu

Although both classical Gaussian mechanisms [1, 2] assume $0 < \epsilon \leq 1$, our review finds that many studies in the literature have used the classical Gaussian mechanisms under values of $\epsilon$ and $\delta$ where the added noise amounts of [1, 2] do not achieve $(\epsilon,\delta)$-DP.

Reconfigurable Intelligent Surface Aided Power Control for Physical-Layer Broadcasting

no code implementations7 Dec 2019 Huimei Han, Jun Zhao, Zehui Xiong, Dusit Niyato, Wenchao Zhai, Marco Di Renzo, Quoc-Viet Pham, Weidang Lu

Our goalis to minimize the transmit power at the BS by jointly designing the transmit beamforming at the BSand the phase shifts of the passive elements at the RIS.

An Adaptive and Fast Convergent Approach to Differentially Private Deep Learning

no code implementations19 Dec 2019 Zhiying Xu, Shuyu Shi, Alex X. Liu, Jun Zhao, Lin Chen

ADADP significantly reduces the privacy cost by improving the convergence speed with an adaptive learning rate and mitigates the negative effect of differential privacy upon the model accuracy by introducing adaptive noise.

AI-GAN: Attack-Inspired Generation of Adversarial Examples

1 code implementation6 Feb 2020 Tao Bai, Jun Zhao, Jinlin Zhu, Shoudong Han, Jiefeng Chen, Bo Li, Alex Kot

Deep neural networks (DNNs) are vulnerable to adversarial examples, which are crafted by adding imperceptible perturbations to inputs.

Poisson Kernel Avoiding Self-Smoothing in Graph Convolutional Networks

no code implementations7 Feb 2020 Ziqing Yang, Shoudong Han, Jun Zhao

Graph convolutional network (GCN) is now an effective tool to deal with non-Euclidean data, such as social networks in social behavior analysis, molecular structure analysis in the field of chemistry, and skeleton-based action recognition.

Action Recognition Skeleton Based Action Recognition

Residual-Sparse Fuzzy $C$-Means Clustering Incorporating Morphological Reconstruction and Wavelet frames

no code implementations14 Feb 2020 Cong Wang, Witold Pedrycz, Zhiwu Li, Mengchu Zhou, Jun Zhao

To further enhance the segmentation effects of the improved FCM algorithm, we also employ the morphological reconstruction to smoothen the labels generated by clustering.

Clustering Image Segmentation +1

Deep Reinforcement Learning Based Intelligent Reflecting Surface for Secure Wireless Communications

no code implementations27 Feb 2020 Helin Yang, Zehui Xiong, Jun Zhao, Dusit Niyato, Liang Xiao, Qingqing Wu

As the system is highly dynamic and complex, and it is challenging to address the non-convex optimization problem, a novel deep reinforcement learning (DRL)-based secure beamforming approach is firstly proposed to achieve the optimal beamforming policy against eavesdroppers in dynamic environments.

reinforcement-learning Reinforcement Learning (RL)

Refinements in Motion and Appearance for Online Multi-Object Tracking

no code implementations16 Mar 2020 Piao Huang, Shoudong Han, Jun Zhao, Donghaisheng Liu, Hongwei Wang, En Yu, Alex ChiChung Kot

Modern multi-object tracking (MOT) system usually involves separated modules, such as motion model for location and appearance model for data association.

Blocking Multi-Object Tracking +1

Local Differential Privacy based Federated Learning for Internet of Things

no code implementations19 Apr 2020 Yang Zhao, Jun Zhao, Mengmeng Yang, Teng Wang, Ning Wang, Lingjuan Lyu, Dusit Niyato, Kwok-Yan Lam

To avoid the privacy threat and reduce the communication cost, in this paper, we propose to integrate federated learning and local differential privacy (LDP) to facilitate the crowdsourcing applications to achieve the machine learning model.

BIG-bench Machine Learning Federated Learning +1

Observed mobility behavior data reveal social distancing inertia

no code implementations30 Apr 2020 Sepehr Ghader, Jun Zhao, Minha Lee, Weiyi Zhou, Guangchen Zhao, Lei Zhang

The study revealed that statistics related to social distancing, namely trip rate, miles traveled per person, and percentage of population staying at home have all showed an unexpected trend, which we named social distancing inertia.

Computers and Society

Attacks to Federated Learning: Responsive Web User Interface to Recover Training Data from User Gradients

no code implementations8 Jun 2020 Hans Albert Lianto, Yang Zhao, Jun Zhao

In a case where the aggregator is untrusted and LDP is not applied to each user gradient, the aggregator can recover sensitive user data from these gradients.

Federated Learning

Secure Beamforming for Multiple Intelligent Reflecting Surfaces Aided mmWave Systems

no code implementations26 Jun 2020 Yue Xiu, Jun Zhao, Chau Yuen, Zhongpei Zhang, Guan Gui

In this system, the secrecy rate is maximized by controlling the on-off status of each IRS as well as optimizing the phase shift matrix of the IRSs.

Intelligent Reflecting Surface Aided MISO Uplink Communication Network: Feasibility and Power Minimization for Perfect and Imperfect CSI

no code implementations3 Jul 2020 Yang Liu, Jun Zhao, Ming Li, Qingqing Wu

In this paper, we consider the weighted sum-power minimization under quality-of-service (QoS) constraints in the multi-user multi-input-single-output (MISO) uplink wireless network assisted by intelligent reflecting surface (IRS).

A novel random access scheme for M2M communication in crowded asynchronous massive MIMO systems

no code implementations13 Jul 2020 Huimei Han, Wenchao Zhai, Zhefu Wu, Ying Li, Jun Zhao, Mingda Chen

Simulation results show that, compared to the exiting random access scheme for the crowded asynchronous massive MIMO systems, the proposed scheme can improve the uplink throughput and estimate the effective timing offsets accurately at the same time.

Secrecy Rate Maximization for Intelligent Reflecting Surface Aided SWIPT Systems

no code implementations22 Jul 2020 Wei Sun, Qingyang Song, Lei Guo, Jun Zhao

Simultaneous wireless information and power transfer (SWIPT) and intelligent reflecting surface (IRS) are two promising techniques for providing enhanced wireless communication capability and sustainable energy supply to energy-constrained wireless devices.

Local Differential Privacy and Its Applications: A Comprehensive Survey

no code implementations9 Aug 2020 Mengmeng Yang, Lingjuan Lyu, Jun Zhao, Tianqing Zhu, Kwok-Yan Lam

Local differential privacy (LDP), as a strong privacy tool, has been widely deployed in the real world in recent years.

Cryptography and Security

MAT: Motion-Aware Multi-Object Tracking

no code implementations10 Sep 2020 Shoudong Han, Piao Huang, Hongwei Wang, En Yu, Donghaisheng Liu, Xiaofeng Pan, Jun Zhao

Modern multi-object tracking (MOT) systems usually model the trajectories by associating per-frame detections.

Multi-Object Tracking Object

Feature Distillation With Guided Adversarial Contrastive Learning

no code implementations21 Sep 2020 Tao Bai, Jinnan Chen, Jun Zhao, Bihan Wen, Xudong Jiang, Alex Kot

In this paper, we propose a novel approach called Guided Adversarial Contrastive Distillation (GACD), to effectively transfer adversarial robustness from teacher to student with features.

Adversarial Robustness Contrastive Learning

Generating Adversarial yet Inconspicuous Patches with a Single Image

no code implementations21 Sep 2020 Jinqi Luo, Tao Bai, Jun Zhao

Through extensive experiments, our ap-proach shows strong attacking ability in both the white-box and black-box setting.

Event Coreference Resolution via a Multi-loss Neural Network without Using Argument Information

no code implementations22 Sep 2020 Xinyu Zuo, Yubo Chen, Kang Liu, Jun Zhao

Event coreference resolution(ECR) is an important task in Natural Language Processing (NLP) and nearly all the existing approaches to this task rely on event argument information.

coreference-resolution Event Argument Extraction +1

Towards Causal Explanation Detection with Pyramid Salient-Aware Network

no code implementations CCL 2020 Xinyu Zuo, Yubo Chen, Kang Liu, Jun Zhao

PSAN can assist in causal explanation detection via capturing the salient semantics of discourses contained in their keywords with a bottom graph-based word-level salient network.

FTN: Foreground-Guided Texture-Focused Person Re-Identification

no code implementations24 Sep 2020 Donghaisheng Liu, Shoudong Han, Yang Chen, Chenfei Xia, Jun Zhao

Person re-identification (Re-ID) is a challenging task as persons are often in different backgrounds.

Person Re-Identification

Secrecy Rate Maximization for Reconfigurable Intelligent Surface Aided Millimeter Wave System with Low-resolution DAC

no code implementations9 Oct 2020 Yue Xiu, Jun Zhao, Zhongpei Zhang

In this letter, we investigate the secrecy rate of an reconfigurable intelligent surface (RIS)-aided millimeter-wave (mmWave) system with hardware limitations.

Secure Weighted Aggregation for Federated Learning

no code implementations17 Oct 2020 Jiale Guo, Ziyao Liu, Kwok-Yan Lam, Jun Zhao, Yiqiang Chen, Chaoping Xing

The situation is exacerbated by the cloud-based implementation of digital services when user data are captured and stored in distributed locations, hence aggregation of the user data for ML could be a serious breach of privacy regulations.

Cryptography and Security Distributed, Parallel, and Cluster Computing

KnowDis: Knowledge Enhanced Data Augmentation for Event Causality Detection via Distant Supervision

no code implementations COLING 2020 Xinyu Zuo, Yubo Chen, Kang Liu, Jun Zhao

Modern models of event causality detection (ECD) are mainly based on supervised learning from small hand-labeled corpora.

Data Augmentation

Joint Entity and Relation Extraction with Set Prediction Networks

1 code implementation3 Nov 2020 Dianbo Sui, Yubo Chen, Kang Liu, Jun Zhao, Xiangrong Zeng, Shengping Liu

Compared with cross-entropy loss that highly penalizes small shifts in triple order, the proposed bipartite matching loss is invariant to any permutation of predictions; thus, it can provide the proposed networks with a more accurate training signal by ignoring triple order and focusing on relation types and entities.

Joint Entity and Relation Extraction Relation +1

Recent Advances in Understanding Adversarial Robustness of Deep Neural Networks

no code implementations3 Nov 2020 Tao Bai, Jinqi Luo, Jun Zhao

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN).

Adversarial Robustness

Field-Tuned Quantum Effects in a Triangular-Lattice Ising Magnet

no code implementations18 Nov 2020 Yayuan Qin, Yao Shen, ChangLe Liu, Hongliang Wo, Yonghao Gao, Yu Feng, Xiaowen Zhang, Gaofeng Ding, Yiqing Gu, Qisi Wang, Shoudong Shen, Helen C. Walker, Robert Bewley, Jianhui Xu, Martin Boehm, Paul Steffens, Seiko Ohira-Kawamura, Naoki Murai, Astrid Schneidewind, Xin Tong, Gang Chen, Jun Zhao

We report thermodynamic and neutron scattering measurements of the triangular-lattice quantum Ising magnet TmMgGaO 4 in longitudinal magnetic fields.

Strongly Correlated Electrons Materials Science

Intelligent Reflecting Surface Aided MISO Uplink Communication Network: Feasibility and Power Minimization for Perfect and Imperfect CSI

no code implementations22 Nov 2020 Yang Liu, Jun Zhao, Ming Li, Qingqing Wu

In this paper, we consider the weighted sum-power minimization under quality-of-service (QoS) constraints in the multi-user multi-input-single-output (MISO) uplink wireless network assisted by intelligent reflecting surface (IRS).

Uplink Achievable Rate Maximization for Reconfigurable Intelligent Surface Aided Millimeter Wave Systems with Resolution-Adaptive ADCs

no code implementations27 Nov 2020 Yue Xiu, Jun Zhao, Ertugrul Basar, Marco Di Renzo, Wei Sun, Guan Gui, Ning Wei

In this letter, we investigate the uplink of a reconfigurable intelligent surface (RIS)-aided millimeter-wave (mmWave) multi-user system.

Quantization

Privacy-Preserving Federated Learning for UAV-Enabled Networks: Learning-Based Joint Scheduling and Resource Management

no code implementations28 Nov 2020 Helin Yang, Jun Zhao, Zehui Xiong, Kwok-Yan Lam, Sumei Sun, Liang Xiao

However, due to the privacy concerns of devices and limited computation or communication resource of UAVs, it is impractical to send raw data of devices to UAV servers for model training.

Distributed Computing Federated Learning +3

Graph-Based Knowledge Integration for Question Answering over Dialogue

no code implementations COLING 2020 Jian Liu, Dianbo Sui, Kang Liu, Jun Zhao

Despite many advances, existing approaches for this task did not consider dialogue structure and background knowledge (e. g., relationships between speakers).

Machine Reading Comprehension Question Answering +1

Privacy and Robustness in Federated Learning: Attacks and Defenses

no code implementations7 Dec 2020 Lingjuan Lyu, Han Yu, Xingjun Ma, Chen Chen, Lichao Sun, Jun Zhao, Qiang Yang, Philip S. Yu

Besides training powerful global models, it is of paramount importance to design FL systems that have privacy guarantees and are resistant to different types of adversaries.

Federated Learning Privacy Preserving

Resource Allocation for Intelligent Reflecting Surface Aided Cooperative Communications

no code implementations18 Dec 2020 Yulan Gao, Chao Yong, Zehui Xiong, Dusit Niyato, Yue Xiao, Jun Zhao

This paper investigates an intelligent reflecting surface (IRS) aided cooperative communication network, where the IRS exploits large reflecting elements to proactively steer the incident radio-frequency wave towards destination terminals (DTs).

A Comprehensive Survey of 6G Wireless Communications

no code implementations21 Dec 2020 Yang Zhao, Wenchao Zhai, Jun Zhao, Tinghao Zhang, Sumei Sun, Dusit Niyato, Kwok-Yan Lam

First, we give an overview of 6G from perspectives of technologies, security and privacy, and applications.

Intelligent Reflecting Surface Assisted Anti-Jamming Communications Based on Reinforcement Learning

no code implementations23 Dec 2020 Helin Yang, Zehui Xiong, Jun Zhao, Dusit Niyato, Qingqing Wu, Massimo Tornatore, Stefano Secci

Aiming to enhance the communication performance against smart jammer, an optimization problem for jointly optimizing power allocation at the base station (BS) and reflecting beamforming at the IRS is formulated.

reinforcement-learning Reinforcement Learning (RL)

An LSTM-Aided Hybrid Random Access Scheme for 6G Machine Type Communication Networks

no code implementations25 Dec 2020 Wenchao Zhai, Huimei Han, Lei Liu, Jun Zhao

In this paper, an LSTM-aided hybrid random access scheme (LSTMH-RA) is proposed to support diverse quality of service (QoS) requirements in 6G machine-type communication (MTC) networks, where massive MTC (mMTC) devices and ultra-reliable low latency communications (URLLC) devices coexist.

ANL: Anti-Noise Learning for Cross-Domain Person Re-Identification

no code implementations27 Dec 2020 Hongliang Zhang, Shoudong Han, Xiaofeng Pan, Jun Zhao

Usually, attributed to the domain gaps, the pre-trained source domain model cannot extract appropriate target domain features, which will dramatically affect the clustering performance and the accuracy of pseudo-labels.

Clustering Contrastive Learning +1

EXPLORING VULNERABILITIES OF BERT-BASED APIS

no code implementations1 Jan 2021 Xuanli He, Lingjuan Lyu, Lichao Sun, Xiaojun Chang, Jun Zhao

We then demonstrate how the extracted model can be exploited to develop effective attribute inference attack to expose sensitive information of the training data.

Attribute Inference Attack +4

Sum-Rate Maximization for UAV-assisted Visible Light Communications using NOMA: Swarm Intelligence meets Machine Learning

no code implementations10 Jan 2021 Quoc-Viet Pham, Thien Huynh-The, Mamoun Alazab, Jun Zhao, Won-Joo Hwang

As the integration of unmanned aerial vehicles (UAVs) into visible light communications (VLC) can offer many benefits for massive-connectivity applications and services in 5G and beyond, this work considers a UAV-assisted VLC using non-orthogonal multiple-access.

BIG-bench Machine Learning

Smart City Enabled by 5G/6G Networks: An Intelligent Hybrid Random Access Scheme

no code implementations16 Jan 2021 Huimei Han, Wenchao Zhai, Jun Zhao

mMTC and URLLC will co-exist in MTC networks for 5G 6G-enabled smart city.

Spectrum Sharing for 6G Integrated Satellite-Terrestrial Communication Networks Based on NOMA and Cognitive Radio

no code implementations27 Jan 2021 Xin Liu, Kwok-Yan Lam, Feng Li, Jun Zhao, Li Wang

ISTCN aims to provide high speed and pervasive network services by integrating broadband terrestrial mobile networks with satellite communication networks.

Management

Joint Transmit Precoding and Reflect Beamforming Design for IRS-Assisted MIMO Cognitive Radio Systems

no code implementations2 Feb 2021 Weiheng Jiang, Yu Zhang, Jun Zhao, Zehui Xiong, Zhiguo Ding

Cognitive radio (CR) is an effective solution to improve the spectral efficiency (SE) of wireless communications by allowing the secondary users (SUs) to share spectrum with primary users (PUs).

Information Theory Signal Processing Information Theory

Recent Advances in Adversarial Training for Adversarial Robustness

no code implementations2 Feb 2021 Tao Bai, Jinqi Luo, Jun Zhao, Bihan Wen, Qian Wang

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models.

Adversarial Robustness

CogNet: Bridging Linguistic Knowledge, World Knowledge and Commonsense Knowledge

no code implementations3 Mar 2021 Chenhao Wang, Yubo Chen, Zhipeng Xue, Yang Zhou, Jun Zhao

In this paper, we present CogNet, a knowledge base (KB) dedicated to integrating three types of knowledge: (1) linguistic knowledge from FrameNet, which schematically describes situations, objects and events.

World Knowledge

Path-based knowledge reasoning with textual semantic information for medical knowledge graph completion

no code implementations27 May 2021 Yinyu Lan, Shizhu He, Xiangrong Zeng, Shengping Liu, Kang Liu, Jun Zhao

To address the above issues, this paper proposes two novel path-based reasoning methods to solve the sparsity issues of entity and path respectively, which adopts the textual semantic information of entities and paths for MedKGC.

LearnDA: Learnable Knowledge-Guided Data Augmentation for Event Causality Identification

no code implementations ACL 2021 Xinyu Zuo, Pengfei Cao, Yubo Chen, Kang Liu, Jun Zhao, Weihua Peng, Yuguang Chen

On the other hand, our approach employs a dual mechanism, which is a learnable augmentation framework and can interactively adjust the generation process to generate task-related sentences.

Data Augmentation Event Causality Identification

MG-DVD: A Real-time Framework for Malware Variant Detection Based on Dynamic Heterogeneous Graph Learning

no code implementations23 Jun 2021 Chen Liu, Bo Li, Jun Zhao, Ming Su, Xu-Dong Liu

In this paper, we propose MG-DVD, a novel detection framework based on dynamic heterogeneous graph learning, to detect malware variants in real time.

Blocking Graph Learning

Inconspicuous Adversarial Patches for Fooling Image Recognition Systems on Mobile Devices

no code implementations29 Jun 2021 Tao Bai, Jinqi Luo, Jun Zhao

The patches are encouraged to be consistent with the background images with adversarial training while preserving strong attack abilities.

Economic Dispatch of an Integrated Microgrid Based on the Dynamic Process of CCGT Plant

no code implementations5 Jul 2021 Zhiyi Lin, Chunyue Song, Jun Zhao, Chao Yang, Huan Yin

Intra-day economic dispatch of an integrated microgrid is a fundamental requirement to integrate distributed generators.

energy management Management

Alignment Rationale for Natural Language Inference

no code implementations ACL 2021 Zhongtao Jiang, Yuanzhe Zhang, Zhao Yang, Jun Zhao, Kang Liu

Deep learning models have achieved great success on the task of Natural Language Inference (NLI), though only a few attempts try to explain their behaviors.

feature selection Natural Language Inference

CogIE: An Information Extraction Toolkit for Bridging Texts and CogNet

1 code implementation ACL 2021 Zhuoran Jin, Yubo Chen, Dianbo Sui, Chenhao Wang, Zhipeng Xue, Jun Zhao

CogNet is a knowledge base that integrates three types of knowledge: linguistic knowledge, world knowledge and commonsense knowledge.

Entity Linking Entity Typing +7

Document-level Event Extraction via Parallel Prediction Networks

2 code implementations ACL 2021 Hang Yang, Dianbo Sui, Yubo Chen, Kang Liu, Jun Zhao, Taifeng Wang

We argue that sentence-level extractors are ill-suited to the DEE task where event arguments always scatter across sentences and multiple events may co-exist in a document.

Document-level Event Extraction Event Extraction +1

Knowledge-Enriched Event Causality Identification via Latent Structure Induction Networks

no code implementations ACL 2021 Pengfei Cao, Xinyu Zuo, Yubo Chen, Kang Liu, Jun Zhao, Yuguang Chen, Weihua Peng

Specifically, to make use of the descriptive knowledge, we devise a Descriptive Graph Induction module to obtain and encode the graph-structured descriptive knowledge.

Descriptive Event Causality Identification

A Large-Scale Chinese Multimodal NER Dataset with Speech Clues

1 code implementation ACL 2021 Dianbo Sui, Zhengkun Tian, Yubo Chen, Kang Liu, Jun Zhao

In this paper, we aim to explore an uncharted territory, which is Chinese multimodal named entity recognition (NER) with both textual and acoustic contents.

named-entity-recognition Named Entity Recognition +1

Lifelong Intent Detection via Multi-Strategy Rebalancing

no code implementations10 Aug 2021 Qingbin Liu, Xiaoyan Yu, Shizhu He, Kang Liu, Jun Zhao

In this paper, we propose Lifelong Intent Detection (LID), which continually trains an ID model on new data to learn newly emerging intents while avoiding catastrophically forgetting old data.

Intent Detection Knowledge Distillation

Logic Traps in Evaluating Attribution Scores

no code implementations ACL 2022 Yiming Ju, Yuanzhe Zhang, Zhao Yang, Zhongtao Jiang, Kang Liu, Jun Zhao

Meanwhile, since the reasoning process of deep models is inaccessible, researchers design various evaluation methods to demonstrate their arguments.

A Relation-Oriented Clustering Method for Open Relation Extraction

1 code implementation EMNLP 2021 Jun Zhao, Tao Gui, Qi Zhang, Yaqian Zhou

The clustering-based unsupervised relation discovery method has gradually become one of the important methods of open relation extraction (OpenRE).

Clustering Relation +1

Adversarial Purification through Representation Disentanglement

no code implementations15 Oct 2021 Tao Bai, Jun Zhao, Lanqing Guo, Bihan Wen

Deep learning models are vulnerable to adversarial examples and make incomprehensible mistakes, which puts a threat on their real-world deployment.

Disentanglement

Optimizing the Age of Information in RIS-aided SWIPT Networks

no code implementations14 Nov 2021 Wanting Lyu, Yue Xiu, Jun Zhao, Zhongpei Zhang

In this letter, a reconfigurable intelligent surface (RIS)-assisted simultaneous wireless information and power transfer (SWIPT) network is investigated.

Scheduling

Towards Efficiently Evaluating the Robustness of Deep Neural Networks in IoT Systems: A GAN-based Method

no code implementations19 Nov 2021 Tao Bai, Jun Zhao, Jinlin Zhu, Shoudong Han, Jiefeng Chen, Bo Li, Alex Kot

Through extensive experiments, AI-GAN achieves high attack success rates, outperforming existing methods, and reduces generation time significantly.

Robust PCA Unrolling Network for Super-resolution Vessel Extraction in X-ray Coronary Angiography

no code implementations16 Apr 2022 Binjie Qin, Haohao Mao, Yiming Liu, Jun Zhao, Yisong Lv, Yueqi Zhu, Song Ding, Xu Chen

Although robust PCA has been increasingly adopted to extract vessels from X-ray coronary angiography (XCA) images, challenging problems such as inefficient vessel-sparsity modelling, noisy and dynamic background artefacts, and high computational cost still remain unsolved.

feature selection Rolling Shutter Correction +1

LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphs

1 code implementation20 Apr 2022 Fei Xia, Bin Li, Yixuan Weng, Shizhu He, Kang Liu, Bin Sun, Shutao Li, Jun Zhao

The medical conversational system can relieve the burden of doctors and improve the efficiency of healthcare, especially during the pandemic.

Conversational Question Answering Dialogue Generation +3

P2ANet: A Dataset and Benchmark for Dense Action Detection from Table Tennis Match Broadcasting Videos

no code implementations26 Jul 2022 Jiang Bian, Xuhong LI, Tao Wang, Qingzhong Wang, Jun Huang, Chen Liu, Jun Zhao, Feixiang Lu, Dejing Dou, Haoyi Xiong

While deep learning has been widely used for video analytics, such as video classification and action detection, dense action detection with fast-moving subjects from sports videos is still challenging.

Action Detection Action Localization +2

Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoder

1 code implementation COLING 2022 Fangyu Lei, Shizhu He, Xiang Li, Jun Zhao, Kang Liu

In the real-world question answering scenarios, hybrid form combining both tabular and textual contents has attracted more and more attention, among which numerical reasoning problem is one of the most typical and challenging problems.

Models Alignment Question Answering

Resource Allocation for Mobile Metaverse with the Internet of Vehicles over 6G Wireless Communications: A Deep Reinforcement Learning Approach

no code implementations27 Sep 2022 Terence Jie Chua, Wenhan Yu, Jun Zhao

Being able to access scenes and information associated with the physical world, in the Metaverse in real-time and under mobility, is essential in developing a highly accessible, interactive and interconnective experience for all users.

Mobile Edge Computing, Metaverse, 6G Wireless Communications, Artificial Intelligence, and Blockchain: Survey and Their Convergence

no code implementations28 Sep 2022 Yitong Wang, Jun Zhao

Compared to cloud computing, as the distributed and closer infrastructure, the convergence of MEC with other emerging technologies, including the Metaverse, 6G wireless communications, artificial intelligence (AI), and blockchain, also solves the problems of network resource allocation, more network load as well as latency requirements.

Cloud Computing Edge-computing

Resource Allocation and Resolution Control in the Metaverse with Mobile Augmented Reality

no code implementations28 Sep 2022 Peiyuan Si, Jun Zhao, Huimei Han, Kwok-Yan Lam, Yang Liu

With the development of blockchain and communication techniques, the Metaverse is considered as a promising next-generation Internet paradigm, which enables the connection between reality and the virtual world.

Joint Optimization of Energy Consumption and Completion Time in Federated Learning

no code implementations29 Sep 2022 Xinyu Zhou, Jun Zhao, Huimei Han, Claude Guet

Federated Learning (FL) is an intriguing distributed machine learning approach due to its privacy-preserving characteristics.

Federated Learning Privacy Preserving +1

Facial Landmark Predictions with Applications to Metaverse

1 code implementation29 Sep 2022 Qiao Han, Jun Zhao, Kwok-Yan Lam

This research aims to make metaverse characters more realistic by adding lip animations learnt from videos in the wild.

Transfer Learning

Time Minimization in Hierarchical Federated Learning

no code implementations7 Oct 2022 Chang Liu, Terence Jie Chua, Jun Zhao

Therefore, we formulate a joint learning and communication optimization problem to minimize total model parameter communication and computation delay, by optimizing local iteration counts and edge iteration counts.

Federated Learning

Edge-Cloud Cooperation for DNN Inference via Reinforcement Learning and Supervised Learning

no code implementations11 Oct 2022 Tinghao Zhang, Zhijun Li, Yongrui Chen, Kwok-Yan Lam, Jun Zhao

A reinforcement learning (RL)-based DNN compression approach is used to generate the lightweight model suitable for the edge from the heavyweight model.

Image Classification object-detection +3

ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chains

no code implementations17 Oct 2022 Minjun Zhu, Yixuan Weng, Shizhu He, Kang Liu, Jun Zhao

Recently, natural language database (NLDB) conducts complex QA in knowledge base with textual evidences rather than structured representations, this task attracts a lot of attention because of the flexibility and richness of textual evidence.

Answer Generation Question Answering +1

Generating Hierarchical Explanations on Text Classification Without Connecting Rules

no code implementations24 Oct 2022 Yiming Ju, Yuanzhe Zhang, Kang Liu, Jun Zhao

The opaqueness of deep NLP models has motivated the development of methods for interpreting how deep models predict.

Clustering text-classification +1

Mobile Augmented Reality with Federated Learning in the Metaverse

no code implementations16 Dec 2022 Xinyu Zhou, Jun Zhao

The Metaverse is deemed the next evolution of the Internet and has received much attention recently.

Federated Learning object-detection +2

Unified, User and Task (UUT) Centered Artificial Intelligence for Metaverse Edge Computing

no code implementations19 Dec 2022 Terence Jie Chua, Wenhan Yu, Jun Zhao

The Metaverse can be considered the extension of the present-day web, which integrates the physical and virtual worlds, delivering hyper-realistic user experiences.

Edge-computing

Large Language Models are Better Reasoners with Self-Verification

1 code implementation19 Dec 2022 Yixuan Weng, Minjun Zhu, Fei Xia, Bin Li, Shizhu He, Shengping Liu, Bin Sun, Kang Liu, Jun Zhao

By performing a backward verification of the answers that LLM deduced for itself, we can obtain interpretable answer validation scores to select the candidate answer with the highest score.

Arithmetic Reasoning Common Sense Reasoning +3

UAV aided Metaverse over Wireless Communications: A Reinforcement Learning Approach

no code implementations4 Jan 2023 Peiyuan Si, Wenhan Yu, Jun Zhao, Kwok-Yan Lam, Qing Yang

A huge amount of data in physical world needs to be synchronized to the virtual world to provide immersive experience for users, and there will be higher requirements on coverage to include more users into Metaverse.

reinforcement-learning Reinforcement Learning (RL)

Knowledge Reasoning via Jointly Modeling Knowledge Graphs and Soft Rules

no code implementations7 Jan 2023 Yinyu Lan, Shizhu He, Kang Liu, Jun Zhao

The former has high accuracy and good interpretability, but a major challenge is to obtain effective rules on large-scale KGs.

Knowledge Graph Embeddings Question Answering

User-centric Heterogeneous-action Deep Reinforcement Learning for Virtual Reality in the Metaverse over Wireless Networks

no code implementations3 Feb 2023 Wenhan Yu, Terence Jie Chua, Jun Zhao

In this paper, for a system consisting of a Metaverse server and multiple VR users, we consider two cases of (i) the server generating frames and transmitting them to users, and (ii) users generating frames locally and thus consuming device energy.

Virtual Reality in Metaverse over Wireless Networks with User-centered Deep Reinforcement Learning

no code implementations8 Mar 2023 Wenhan Yu, Terence Jie Chua, Jun Zhao

Virtual reality (VR) technologies are the backbone for the virtual universe within the Metaverse as they enable a hyper-realistic and immersive experience, and especially so in the context of socialization.

Detection of Uncertainty in Exceedance of Threshold (DUET): An Adversarial Patch Localizer

no code implementations18 Mar 2023 Terence Jie Chua, Wenhan Yu, Jun Zhao

We then conduct further analyses on our choice of model priors and the adoption of Bayesian Neural Networks in different layers within our model architecture.

Self-Driving Cars

Mobile Edge Adversarial Detection for Digital Twinning to the Metaverse with Deep Reinforcement Learning

no code implementations18 Mar 2023 Terence Jie Chua, Wenhan Yu, Jun Zhao

Nevertheless, as real-time, accurate detection of adversarial patches is compute-intensive, these physical world scenes have to be offloaded to the Metaverse Map Base Stations (MMBS) for computation.

Towards Adversarially Robust Continual Learning

no code implementations31 Mar 2023 Tao Bai, Chen Chen, Lingjuan Lyu, Jun Zhao, Bihan Wen

Recent studies show that models trained by continual learning can achieve the comparable performances as the standard supervised learning and the learning flexibility of continual learning models enables their wide applications in the real world.

Adversarial Robustness Continual Learning

Mastering Symbolic Operations: Augmenting Language Models with Compiled Neural Networks

3 code implementations4 Apr 2023 Yixuan Weng, Minjun Zhu, Fei Xia, Bin Li, Shizhu He, Kang Liu, Jun Zhao

Our work highlights the potential of seamlessly unifying explicit rule learning via CoNNs and implicit pattern learning in LMs, paving the way for true symbolic comprehension capabilities.

Arithmetic Reasoning Language Modelling

Multi-View Graph Representation Learning for Answering Hybrid Numerical Reasoning Question

1 code implementation5 May 2023 Yifan Wei, Fangyu Lei, Yuanzhe Zhang, Jun Zhao, Kang Liu

Hybrid question answering (HybridQA) over the financial report contains both textual and tabular data, and requires the model to select the appropriate evidence for the numerical reasoning task.

Graph Representation Learning Machine Reading Comprehension +1

Large Language Models Need Holistically Thought in Medical Conversational QA

1 code implementation9 May 2023 Yixuan Weng, Bin Li, Fei Xia, Minjun Zhu, Bin Sun, Shizhu He, Kang Liu, Jun Zhao

The medical conversational question answering (CQA) system aims at providing a series of professional medical services to improve the efficiency of medical care.

Conversational Question Answering

S$^3$HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering

1 code implementation19 May 2023 Fangyu Lei, Xiang Li, Yifan Wei, Shizhu He, Yiming Huang, Jun Zhao, Kang Liu

In this paper, we propose a three-stage TextTableQA framework S3HQA, which comprises of retriever, selector, and reasoner.

Question Answering Reading Comprehension

Towards Graph-hop Retrieval and Reasoning in Complex Question Answering over Textual Database

no code implementations23 May 2023 Minjun Zhu, Yixuan Weng, Shizhu He, Kang Liu, Jun Zhao

In Textual question answering (TQA) systems, complex questions often require retrieving multiple textual fact chains with multiple reasoning steps.

Question Answering Retrieval

A Hybrid Framework of Reinforcement Learning and Convex Optimization for UAV-Based Autonomous Metaverse Data Collection

no code implementations29 May 2023 Peiyuan Si, Liangxin Qian, Jun Zhao, Kwok-Yan Lam

Unmanned aerial vehicles (UAVs) are promising for providing communication services due to their advantages in cost and mobility, especially in the context of the emerging Metaverse and Internet of Things (IoT).

Open Set Relation Extraction via Unknown-Aware Training

1 code implementation8 Jun 2023 Jun Zhao, Xin Zhao, WenYu Zhan, Qi Zhang, Tao Gui, Zhongyu Wei, Yunwen Chen, Xiang Gao, Xuanjing Huang

Inspired by text adversarial attacks, we adaptively apply small but critical perturbations to original training instances and thus synthesizing negative instances that are more likely to be mistaken by the model as known relations.

Relation Relation Extraction

Heterogeneous 360 Degree Videos in Metaverse: Differentiated Reinforcement Learning Approaches

no code implementations8 Aug 2023 Wenhan Yu, Jun Zhao

Advanced video technologies are driving the development of the futuristic Metaverse, which aims to connect users from anywhere and anytime.

reinforcement-learning

UAV-assisted Semantic Communication with Hybrid Action Reinforcement Learning

no code implementations18 Aug 2023 Peiyuan Si, Jun Zhao, Kwok-Yan Lam, Qing Yang

In this paper, we aim to explore the use of uplink semantic communications with the assistance of UAV in order to improve data collection effiicency for metaverse users in remote areas.

reinforcement-learning Reinforcement Learning (RL)

SHARK: A Lightweight Model Compression Approach for Large-scale Recommender Systems

no code implementations18 Aug 2023 Beichuan Zhang, Chenggen Sun, Jianchao Tan, Xinjun Cai, Jun Zhao, Mengqi Miao, Kang Yin, Chengru Song, Na Mou, Yang song

Increasing the size of embedding layers has shown to be effective in improving the performance of recommendation models, yet gradually causing their sizes to exceed terabytes in industrial recommender systems, and hence the increase of computing and storage costs.

Model Compression Quantization +1

LMTuner: An user-friendly and highly-integrable Training Framework for fine-tuning Large Language Models

1 code implementation20 Aug 2023 Yixuan Weng, Zhiqi Wang, Huanxuan Liao, Shizhu He, Shengping Liu, Kang Liu, Jun Zhao

With the burgeoning development in the realm of large language models (LLMs), the demand for efficient incremental training tailored to specific industries and domains continues to increase.

Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neurons

1 code implementation25 Aug 2023 YuHeng Chen, Pengfei Cao, Yubo Chen, Kang Liu, Jun Zhao

We design cross-lingual knowledge editing experiments, demonstrating that the PLMs can accomplish this task based on language-independent neurons; (2) The discovery of Degenerate Knowledge Neurons, a novel type of neuron showing that different knowledge neurons can store the same fact.

Fact Checking knowledge editing

ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models

no code implementations28 Aug 2023 Baoli Zhang, Haining Xie, Pengfan Du, JunHao Chen, Pengfei Cao, Yubo Chen, Shengping Liu, Kang Liu, Jun Zhao

To this end, we propose the ZhuJiu benchmark, which has the following strengths: (1) Multi-dimensional ability coverage: We comprehensively evaluate LLMs across 7 ability dimensions covering 51 tasks.

Interpreting Sentiment Composition with Latent Semantic Tree

1 code implementation31 Aug 2023 Zhongtao Jiang, Yuanzhe Zhang, Cao Liu, Jiansong Chen, Jun Zhao, Kang Liu

As the key to sentiment analysis, sentiment composition considers the classification of a constituent via classifications of its contained sub-constituents and rules operated on them.

Classification Domain Adaptation +1

MMHQA-ICL: Multimodal In-context Learning for Hybrid Question Answering over Text, Tables and Images

no code implementations9 Sep 2023 Weihao Liu, Fangyu Lei, Tongxu Luo, Jiahe Lei, Shizhu He, Jun Zhao, Kang Liu

Most importantly, we propose a Type-specific In-context Learning Strategy for MMHQA, enabling LLMs to leverage their powerful performance in this task.

In-Context Learning Question Answering +1

MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models

1 code implementation8 Oct 2023 Yifan Wei, Yisong Su, Huanhuan Ma, Xiaoyan Yu, Fangyu Lei, Yuanzhe Zhang, Jun Zhao, Kang Liu

As a result, it is natural for people to believe that LLMs have also mastered abilities such as time understanding and reasoning.

counterfactual

Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedback

no code implementations8 Oct 2023 Wei Shen, Rui Zheng, WenYu Zhan, Jun Zhao, Shihan Dou, Tao Gui, Qi Zhang, Xuanjing Huang

Reinforcement learning from human feedback serves as a crucial bridge, aligning large language models with human and societal values.

Language Modelling

Boosting Black-box Attack to Deep Neural Networks with Conditional Diffusion Models

no code implementations11 Oct 2023 Renyang Liu, Wei Zhou, Tianwei Zhang, Kangjie Chen, Jun Zhao, Kwok-Yan Lam

Existing black-box attacks have demonstrated promising potential in creating adversarial examples (AE) to deceive deep learning models.

Denoising

Can LSH (Locality-Sensitive Hashing) Be Replaced by Neural Network?

no code implementations15 Oct 2023 Renyang Liu, Jun Zhao, Xing Chu, Yu Liang, Wei Zhou, Jing He

With the rapid development of GPU (Graphics Processing Unit) technologies and neural networks, we can explore more appropriate data structures and algorithms.

SCME: A Self-Contrastive Method for Data-free and Query-Limited Model Extraction Attack

no code implementations15 Oct 2023 Renyang Liu, Jinhong Zhang, Kwok-Yan Lam, Jun Zhao, Wei Zhou

However, the distribution of these fake data lacks diversity and cannot detect the decision boundary of the target model well, resulting in the dissatisfactory simulation effect.

Model extraction

Generative Calibration for In-context Learning

1 code implementation16 Oct 2023 Zhongtao Jiang, Yuanzhe Zhang, Cao Liu, Jun Zhao, Kang Liu

In this paper, we for the first time theoretically and empirically identify that such a paradox is mainly due to the label shift of the in-context model to the data distribution, in which LLMs shift the label marginal $p(y)$ while having a good label conditional $p(x|y)$.

In-Context Learning text-classification +1

Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphs

1 code implementation17 Oct 2023 Yao Xu, Shizhu He, Cunguang Wang, Li Cai, Kang Liu, Jun Zhao

However, these methods train KG embeddings and neural set operators concurrently on both simple (one-hop) and complex (multi-hop and logical) queries, which causes performance degradation on simple queries and low training efficiency.

Complex Query Answering

Unveiling A Core Linguistic Region in Large Language Models

no code implementations23 Oct 2023 Jun Zhao, Zhihao Zhang, Yide Ma, Qi Zhang, Tao Gui, Luhui Gao, Xuanjing Huang

We have discovered a core region in LLMs that corresponds to linguistic competence, accounting for approximately 1% of the total model parameters.

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models

2 code implementations23 Oct 2023 Fangyu Lei, Qian Liu, Yiming Huang, Shizhu He, Jun Zhao, Kang Liu

The rapid development of Large Language Models (LLMs) has led to great strides in model capabilities like long-context understanding and reasoning.

Long-Context Understanding

TableQAKit: A Comprehensive and Practical Toolkit for Table-based Question Answering

no code implementations23 Oct 2023 Fangyu Lei, Tongxu Luo, Pengqi Yang, Weihao Liu, Hanwen Liu, Jiahe Lei, Yiming Huang, Yifan Wei, Shizhu He, Jun Zhao, Kang Liu

Table-based question answering (TableQA) is an important task in natural language processing, which requires comprehending tables and employing various reasoning ways to answer the questions.

Question Answering

Cannot find the paper you are looking for? You can Submit a new open access paper.