Search Results for author: Bingshuo Qian

Found 1 papers, 0 papers with code

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models

no code implementations22 Oct 2024 Yuheng Lu, Bingshuo Qian, Caixia Yuan, Huixing Jiang, Xiaojie Wang

Large language models (LLMs) exhibit remarkable capabilities in natural language processing but face catastrophic forgetting when learning new tasks, where adaptation to a new domain leads to a substantial decline in performance on previous tasks.

Cannot find the paper you are looking for? You can Submit a new open access paper.