Search Results for author: Chengwei Dai

Found 4 papers, 4 papers with code

Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation

1 code implementation30 May 2024 Chengwei Dai, Kun Li, Wei Zhou, Songlin Hu

Further analysis shows that EDIT can generate high-quality CoTs with more correct key reasoning steps.

Imitation Learning

Improve Student's Reasoning Generalizability through Cascading Decomposed CoTs Distillation

1 code implementation30 May 2024 Chengwei Dai, Kun Li, Wei Zhou, Songlin Hu

Specifically, by restructuring the training objectives -- removing the answer from outputs and concatenating the question with the rationale as input -- CasCoD's two-step learning process ensures that students focus on learning rationales without interference from the preset answers, thus improving reasoning generalizability.

CT-GAT: Cross-Task Generative Adversarial Attack based on Transferability

1 code implementation22 Oct 2023 Minxuan Lv, Chengwei Dai, Kun Li, Wei Zhou, Songlin Hu

Neural network models are vulnerable to adversarial examples, and adversarial transferability further increases the risk of adversarial attacks.

Adversarial Attack

MeaeQ: Mount Model Extraction Attacks with Efficient Queries

1 code implementation21 Oct 2023 Chengwei Dai, Minxuan Lv, Kun Li, Wei Zhou

We study model extraction attacks in natural language processing (NLP) where attackers aim to steal victim models by repeatedly querying the open Application Programming Interfaces (APIs).

Active Learning Model extraction

Cannot find the paper you are looking for? You can Submit a new open access paper.