We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 7946e4f commit bdef124Copy full SHA for bdef124
mft_peft_hf/README_cn.md
@@ -93,6 +93,7 @@
93
94
### 3.2 LoRA/QLoRA微调
95
关于LoRA的详细介绍可参考论文:[LORA: LOW-RANK ADAPTATION OF LARGE LANGUAGE MODELS](https://arxiv.org/pdf/2106.09685.pdf)
96
+
97
关于QLoRA的详细介绍可参考论文:[QLORA: Efficient Finetuning of Quantized LLMs](https://arxiv.org/pdf/2305.14314.pdf)
98
99
QLoRA通过4-bit的nf4量化,且加入更多adapter,在大幅减少显存消耗的同时,尽可能逼近全量参数微调的效果。
0 commit comments