Fine-Tuning
MixLoRA
Introduced by Li et al. in MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of ExpertsMixLoRA is a type of PEFT method which construct a resource-efficient sparse MoE model based on LoRA.
Source: MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
Papers
| Paper | Code | Results | Date | Stars |
|---|
Transformer
