Search Results for author: Yanmeng Wang

Found 8 papers, 2 papers with code

PINGAN Omini-Sinitic at SemEval-2022 Task 4: Multi-prompt Training for Patronizing and Condescending Language Detection

no code implementations SemEval (NAACL) 2022 Ye Wang, Yanmeng Wang, Baishun Ling, Zexiang Liao, Shaojun Wang, Jing Xiao

This paper describes the second-placed system for subtask 2 and the ninth-placed system for subtask 1 in SemEval 2022 Task 4: Patronizing and Condescending Language Detection.

Binary Classification Classification +2

$z$-SignFedAvg: A Unified Stochastic Sign-based Compression for Federated Learning

no code implementations6 Feb 2023 Zhiwei Tang, Yanmeng Wang, Tsung-Hui Chang

In this paper, we propose a novel noisy perturbation scheme with a general symmetric noise distribution for sign-based compression, which not only allows one to flexibly control the tradeoff between gradient bias and convergence performance, but also provides a unified viewpoint to existing stochastic sign-based methods.

Federated Learning Privacy Preserving

Why Batch Normalization Damage Federated Learning on Non-IID Data?

1 code implementation8 Jan 2023 Yanmeng Wang, Qingjiang Shi, Tsung-Hui Chang

In view of this, we develop a new FL algorithm that is tailored to BN, called FedTAN, which is capable of achieving robust FL performance under a variety of data distributions via iterative layer-wise parameter aggregation.

Federated Learning

Improving Variational Autoencoders with Density Gap-based Regularization

1 code implementation1 Nov 2022 Jianfei Zhang, Jun Bai, Chenghua Lin, Yanmeng Wang, Wenge Rong

There are effective ways proposed to prevent posterior collapse in VAEs, but we observe that they in essence make trade-offs between posterior collapse and hole problem, i. e., mismatch between the aggregated posterior distribution and the prior distribution.

Language Modelling Representation Learning

Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval

no code implementations Findings (EMNLP) 2021 Yanmeng Wang, Jun Bai, Ye Wang, Jianfei Zhang, Wenge Rong, Zongcheng Ji, Shaojun Wang, Jing Xiao

To keep independent encoding of questions and answers during inference stage, variational auto-encoder is further introduced to reconstruct answers (questions) from question (answer) embeddings as an auxiliary task to enhance QA interaction in representation learning in training stage.

Question Answering Representation Learning +2

PINGAN Omini-Sinitic at SemEval-2021 Task 4:Reading Comprehension of Abstract Meaning

no code implementations SEMEVAL 2021 Ye Wang, Yanmeng Wang, Haijun Zhu, Bo Zeng, Zhenghong Hao, Shaojun Wang, Jing Xiao

This paper describes the winning system for subtask 2 and the second-placed system for subtask 1 in SemEval 2021 Task 4: ReadingComprehension of Abstract Meaning.

Denoising Language Modelling +1

Quantized Federated Learning under Transmission Delay and Outage Constraints

no code implementations17 Jun 2021 Yanmeng Wang, Yanqing Xu, Qingjiang Shi, Tsung-Hui Chang

Federated learning (FL) has been recognized as a viable distributed learning paradigm which trains a machine learning model collaboratively with massive mobile devices in the wireless edge while protecting user privacy.

Federated Learning Quantization

Elastic CRFs for Open-ontology Slot Filling

no code implementations4 Nov 2018 Yinpei Dai, Yichi Zhang, Zhijian Ou, Yanmeng Wang, Junlan Feng

Second, the one-hot encoding of slot labels ignores the semantic meanings and relations for slots, which are implicit in their natural language descriptions.

slot-filling Slot Filling

Cannot find the paper you are looking for? You can Submit a new open access paper.