Update README.md
Browse files
README.md
CHANGED
@@ -6,17 +6,31 @@ tags:
|
|
6 |
- text-generation-inference
|
7 |
- transformers
|
8 |
- unsloth
|
9 |
-
-
|
10 |
- trl
|
|
|
11 |
base_model: unsloth/gemma-1.1-7b-it-bnb-4bit
|
|
|
|
|
12 |
---
|
13 |
|
14 |
-
# Uploaded model
|
15 |
-
|
16 |
- **Developed by:** Shekswess
|
17 |
- **License:** apache-2.0
|
18 |
- **Finetuned from model :** unsloth/gemma-1.1-7b-it-bnb-4bit
|
19 |
|
20 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
|
22 |
-
[
|
|
|
6 |
- text-generation-inference
|
7 |
- transformers
|
8 |
- unsloth
|
9 |
+
- mistral
|
10 |
- trl
|
11 |
+
- medical
|
12 |
base_model: unsloth/gemma-1.1-7b-it-bnb-4bit
|
13 |
+
datasets:
|
14 |
+
- Shekswess/medical_gemma_instruct_dataset_short
|
15 |
---
|
16 |
|
|
|
|
|
17 |
- **Developed by:** Shekswess
|
18 |
- **License:** apache-2.0
|
19 |
- **Finetuned from model :** unsloth/gemma-1.1-7b-it-bnb-4bit
|
20 |
|
21 |
+
To utilize the finetuning of the model, you need to use the gemma instruction prompt template for this medical version of the model :
|
22 |
+
```
|
23 |
+
<start_of_turn>user Answer the question truthfully, you are a medical professional. This is the question: {question}<end_of_turn>
|
24 |
+
```
|
25 |
+
|
26 |
+
Metrics:
|
27 |
+
|
28 |
+
- train_runtime: 4544.6901
|
29 |
+
- train_samples_per_second: 0.66
|
30 |
+
- train_steps_per_second: 0.083
|
31 |
+
- total_flos: 5.862681923842867e+16
|
32 |
+
- train_loss: 1.7245690104166667
|
33 |
+
- steps: 375
|
34 |
+
- epoch: 1.0
|
35 |
|
36 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6569f13004643352df96e40f/L22u9s2ShJRwg3AdYs-06.png)
|