Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ tags:
|
|
17 |
llava-Qwen2-7B-Instruct-Chinese-CLIP = Qwen/Qwen2-7B-Instruct + multi_modal_projector + OFA-Sys/chinese-clip-vit-large-patch14-336px</br>
|
18 |
|
19 |
2. 微调模块
|
20 |
-
- vision_tower和language_model的q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
|
21 |
- mmp层全量训练</br>
|
22 |
|
23 |
3. 微调</br>
|
|
|
17 |
llava-Qwen2-7B-Instruct-Chinese-CLIP = Qwen/Qwen2-7B-Instruct + multi_modal_projector + OFA-Sys/chinese-clip-vit-large-patch14-336px</br>
|
18 |
|
19 |
2. 微调模块
|
20 |
+
- vision_tower和language_model的q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj模块进行lora训练</br>
|
21 |
- mmp层全量训练</br>
|
22 |
|
23 |
3. 微调</br>
|