2 code implementations • 19 Aug 2024 • Di Fang, Yinan Zhu, Runze Fang, Cen Chen, Ziqian Zeng, Huiping Zhuang
To solve this problem, we propose an analytic imbalance rectifier algorithm (AIR), a novel online exemplar-free continual learning method with an analytic (i. e., closed-form) solution for data-imbalanced class-incremental learning (CIL) and generalized CIL scenarios in real-world continual learning.
1 code implementation • 20 Jun 2024 • Tao Zhang, Ziqian Zeng, Yuxiang Xiao, Huiping Zhuang, Cen Chen, James Foulds, SHimei Pan
Furthermore, we categorized the gender biases in the "rejected" responses of GenderAlign into 4 principal categories.
no code implementations • 3 Jun 2024 • Ziqian Zeng, Jianwei Wang, Zhengdong Lu, Huiping Zhuang, Cen Chen
In this paper, we propose PrivacyRestore to protect the privacy of user inputs during LLM inference.
1 code implementation • 28 May 2024 • Huiping Zhuang, Di Fang, Kai Tong, Yuchen Liu, Ziqian Zeng, Xu Zhou, Cen Chen
One of these scenarios can be formulated as an online continual learning (OCL) problem.
1 code implementation • 25 May 2024 • Huiping Zhuang, Run He, Kai Tong, Di Fang, Han Sun, Haoran Li, Tianyi Chen, Ziqian Zeng
In this paper, we introduce analytic federated learning (AFL), a new training paradigm that brings analytical (i. e., closed-form) solutions to the federated learning (FL) community.
no code implementations • 23 May 2024 • Haoran Li, Xinyuan Zhao, Dadi Guo, Hanlin Gu, Ziqian Zeng, Yuxing Han, Yangqiu Song, Lixin Fan, Qiang Yang
In this paper, we introduce a Federated Domain-specific Knowledge Transfer (FDKT) framework, which enables domain-specific knowledge transfer from LLMs to SLMs while preserving clients' data privacy.
1 code implementation • 8 Apr 2024 • Weikai Lu, Ziqian Zeng, Jianwei Wang, Zhengdong Lu, Zelin Chen, Huiping Zhuang, Cen Chen
Jailbreaking attacks can enable Large Language Models (LLMs) to bypass the safeguard and generate harmful content.
1 code implementation • 26 Mar 2024 • Huiping Zhuang, Run He, Kai Tong, Ziqian Zeng, Cen Chen, Zhiping Lin
The compensation stream is governed by a Dual-Activation Compensation (DAC) module.
no code implementations • 23 Mar 2024 • Huiping Zhuang, Yuchen Liu, Run He, Kai Tong, Ziqian Zeng, Cen Chen, Yi Wang, Lap-Pui Chau
Online Class Incremental Learning (OCIL) aims to train the model in a task-by-task manner, where data arrive in mini-batches at a time while previous data are not accessible.
1 code implementation • 23 Mar 2024 • Huiping Zhuang, Yizhu Chen, Di Fang, Run He, Kai Tong, Hongxin Wei, Ziqian Zeng, Cen Chen
The generalized CIL (GCIL) aims to address the CIL problem in a more real-world scenario, where incoming data have mixed data categories and unknown sample size distribution, leading to intensified forgetting.
1 code implementation • 28 Feb 2024 • Jianwei Wang, Tianyin Wang, Ziqian Zeng
Recent zero-shot classification methods converted the task to other NLP tasks (e. g., textual entailment) and used off-the-shelf models of these NLP tasks to directly perform inference on the test data without using a large amount of IE annotation data.
1 code implementation • 24 Feb 2024 • Ziqian Zeng, Jiahong Yu, Qianshi Pang, ZiHao Wang, Huiping Zhuang, HongEn Shao, Xiaofeng Zou
Within this framework, we introduce a lightweight draft model that effectively utilizes previously generated tokens to predict subsequent words.
no code implementations • 9 Feb 2024 • Wenyu Li, Yinuo Zhu, Xin Lin, Ming Li, Ziyue Jiang, Ziqian Zeng
Traditional discriminative approaches in mental health analysis are known for their strong capacity but lack interpretability and demand large-scale annotated data.
1 code implementation • 19 Dec 2023 • Ziqian Zeng, Yihuai Hong, Hongliang Dai, Huiping Zhuang, Cen Chen
We propose ConsistentEE, an early exiting method that is consistent in training and inference.
1 code implementation • 11 Dec 2023 • Hongliang Dai, Ziqian Zeng
We can simply fine-tune the previously trained model with a small number of examples annotated under this schema.
no code implementations • 23 Oct 2023 • Libo Zhao, Kai Fan, Wei Luo, Jing Wu, Shushu Wang, Ziqian Zeng, Zhongqiang Huang
Simultaneous machine translation (SiMT) requires a robust read/write policy in conjunction with a high-quality translation model.
1 code implementation • CVPR 2023 • Huiping Zhuang, Zhenyu Weng, Run He, Zhiping Lin, Ziqian Zeng
In this paper, we approach the FSCIL by adopting analytic learning, a technique that converts network training into linear problems.
no code implementations • 25 Nov 2022 • Tianyin Wang, Jianwei Wang, Ziqian Zeng
In this paper, we propose to first detect a small amount of clean data from silver standard data and then use the selected clean data to finetune the pretrained model.
1 code implementation • Findings (NAACL) 2022 • Ziqian Zeng, Weimin Ni, Tianqing Fang, Xiang Li, Xinran Zhao, Yangqiu Song
In this paper, we propose to query a masked language model with cloze style prompts to obtain supervision signals.
1 code implementation • EACL 2021 • Ziqian Zeng, Yangqiu Song
In this paper, we propose a posterior regularization framework for the variational approach to the weakly supervised sentiment analysis to better control the posterior distribution of the label assignment.
1 code implementation • 18 Apr 2021 • Ziqian Zeng, Rashidul Islam, Kamrun Naher Keya, James Foulds, Yangqiu Song, SHimei Pan
Recently, much attention has been paid to the societal impact of AI, especially concerns regarding its fairness.
no code implementations • 2 Sep 2020 • Rashidul Islam, Kamrun Naher Keya, Ziqian Zeng, SHimei Pan, James Foulds
A growing proportion of human interactions are digitized on social media platforms and subjected to algorithmic decision-making, and it has become increasingly important to ensure fair treatment from these algorithms.
no code implementations • 21 Aug 2020 • Ziqian Zeng, Wenxuan Zhou, Xin Liu, Zizheng Lin, Yangqin Song, Michael David Kuo, Wan Hang Keith Chiu
Our objective function is to predict an opinion word given a target word while our ultimate goal is to learn a sentiment classifier.
1 code implementation • NAACL 2019 • Ziqian Zeng, Wenxuan Zhou, Xin Liu, Yangqiu Song
These word pairs can be extracted by using dependency parsers and simple rules.