Update README.md
Browse files
README.md
CHANGED
@@ -6,13 +6,13 @@ language:
|
|
6 |
- en
|
7 |
---
|
8 |
|
9 |
-
|
10 |
*Update: Having a bit issue with the tokenizer, still figuring things out.
|
11 |
|
12 |
|
13 |
Reproduce Vicuna, but based on yi-6B. The training data I used was ShareGPT_V3_unfiltered_cleaned_split_no_imsorry.json.
|
14 |
|
15 |
-
|
16 |
```
|
17 |
CUDA_VISIBLE_DEVICES=0,1,2,3,5 torchrun --nproc_per_node 5 ../supervised_finetuning.py \
|
18 |
--model_type auto \
|
|
|
6 |
- en
|
7 |
---
|
8 |
|
9 |
+
|
10 |
*Update: Having a bit issue with the tokenizer, still figuring things out.
|
11 |
|
12 |
|
13 |
Reproduce Vicuna, but based on yi-6B. The training data I used was ShareGPT_V3_unfiltered_cleaned_split_no_imsorry.json.
|
14 |
|
15 |
+
The training framework I used https://github.com/shibing624/MedicalGPT , train shell:
|
16 |
```
|
17 |
CUDA_VISIBLE_DEVICES=0,1,2,3,5 torchrun --nproc_per_node 5 ../supervised_finetuning.py \
|
18 |
--model_type auto \
|