HenryJJ commited on
Commit
c1d0441
1 Parent(s): 82f29c7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -1
README.md CHANGED
@@ -2,4 +2,34 @@
2
  license: apache-2.0
3
  datasets:
4
  - databricks/databricks-dolly-15k
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  datasets:
4
  - databricks/databricks-dolly-15k
5
+ ---
6
+
7
+ # Instruct_Mixtral-7B-v0.1_Dolly15K
8
+ Fine-tuned from Mixtral-7B-v0.1, used Dolly15k for the dataset. 90% for training, 10% validation. Trained for 2.0 epochs using Lora. Trained with 1024 context window.
9
+
10
+ # Model Details
11
+ * **Trained by**: trained by HenryJJ.
12
+ * **Model type:** **Instruct_Mixtral-7B-v0.1_Dolly15K** is an auto-regressive language model based on the Llama 2 transformer architecture.
13
+ * **Language(s)**: English
14
+ * **License for Instruct_Mixtral-8x7B-v0.1_Dolly15K**: apache-2.0 license
15
+
16
+
17
+ # Prompting
18
+
19
+ ## Prompt Template With Context
20
+
21
+ ```
22
+ Write a 10-line poem about a given topic
23
+
24
+ Input:
25
+
26
+ The topic is about racecars
27
+
28
+ Output:
29
+ ```
30
+ ## Prompt Template Without Context
31
+ ```
32
+ Who was the was the second president of the United States?
33
+
34
+ Output:
35
+ ```