Update README.md
Browse files
README.md
CHANGED
@@ -2,4 +2,34 @@
|
|
2 |
license: apache-2.0
|
3 |
datasets:
|
4 |
- databricks/databricks-dolly-15k
|
5 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
license: apache-2.0
|
3 |
datasets:
|
4 |
- databricks/databricks-dolly-15k
|
5 |
+
---
|
6 |
+
|
7 |
+
# Instruct_Mixtral-7B-v0.1_Dolly15K
|
8 |
+
Fine-tuned from Mixtral-7B-v0.1, used Dolly15k for the dataset. 90% for training, 10% validation. Trained for 2.0 epochs using Lora. Trained with 1024 context window.
|
9 |
+
|
10 |
+
# Model Details
|
11 |
+
* **Trained by**: trained by HenryJJ.
|
12 |
+
* **Model type:** **Instruct_Mixtral-7B-v0.1_Dolly15K** is an auto-regressive language model based on the Llama 2 transformer architecture.
|
13 |
+
* **Language(s)**: English
|
14 |
+
* **License for Instruct_Mixtral-8x7B-v0.1_Dolly15K**: apache-2.0 license
|
15 |
+
|
16 |
+
|
17 |
+
# Prompting
|
18 |
+
|
19 |
+
## Prompt Template With Context
|
20 |
+
|
21 |
+
```
|
22 |
+
Write a 10-line poem about a given topic
|
23 |
+
|
24 |
+
Input:
|
25 |
+
|
26 |
+
The topic is about racecars
|
27 |
+
|
28 |
+
Output:
|
29 |
+
```
|
30 |
+
## Prompt Template Without Context
|
31 |
+
```
|
32 |
+
Who was the was the second president of the United States?
|
33 |
+
|
34 |
+
Output:
|
35 |
+
```
|