Search Results for author: Xiaohui Wang

Found 7 papers, 4 papers with code

基于Self-Attention的句法感知汉语框架语义角色标注(Syntax-Aware Chinese Frame Semantic Role Labeling Based on Self-Attention)

no code implementations CCL 2020 Xiaohui Wang, Ru Li, Zhiqiang Wang, Qinghua Chai, Xiaoqi Han

框架语义角色标注(Frame Semantic Role Labeling, FSRL)是基于FrameNet标注体系的语义分析任务。语义角色标注通常对句法有很强的依赖性, 目前的语义角色标注模型大多基于双向长短时记忆网络Bi-LSTM, 虽然可以获取句子中的长距离依赖信息, 但无法很好获取句子中的句法信息。因此, 引入self-attention机制来捕获句子中每个词的句法信息。实验结果表明, 该模型在CFN(Chinese FrameNet, 汉语框架网)数据集上的F1达到83. 77%, 提升了近11%。

Semantic Role Labeling

Understanding Parameter Sharing in Transformers

no code implementations15 Jun 2023 Ye Lin, Mingxuan Wang, Zhexi Zhang, Xiaohui Wang, Tong Xiao, Jingbo Zhu

Inspired by this, we tune the training hyperparameters related to model convergence in a targeted manner.

Machine Translation

MobileNMT: Enabling Translation in 15MB and 30ms

1 code implementation7 Jun 2023 Ye Lin, Xiaohui Wang, Zhexi Zhang, Mingxuan Wang, Tong Xiao, Jingbo Zhu

With the co-design of model and engine, compared with the existing system, we speed up 47. 0x and save 99. 5% of memory with only 11. 6% loss of BLEU.

Model Compression NMT +2

LightSeq2: Accelerated Training for Transformer-based Models on GPUs

1 code implementation12 Oct 2021 Xiaohui Wang, Yang Wei, Ying Xiong, Guyue Huang, Xian Qian, Yufei Ding, Mingxuan Wang, Lei LI

In this paper, we present LightSeq2, a system to accelerate training for a general family of Transformer models on GPUs.

Decoder Machine Translation +2

An Efficient Agreement Mechanism in CapsNets By Pairwise Product

1 code implementation1 Apr 2020 Lei Zhao, Xiaohui Wang, Lei Huang

Capsule networks (CapsNets) are capable of modeling visual hierarchical relationships, which is achieved by the "routing-by-agreement" mechanism.

Cannot find the paper you are looking for? You can Submit a new open access paper.