xriminact commited on
Commit
e8dab99
1 Parent(s): 0ee8c18

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -6,4 +6,20 @@ language:
6
  - en
7
  library_name: adapter-transformers
8
  pipeline_tag: text-generation
9
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  - en
7
  library_name: adapter-transformers
8
  pipeline_tag: text-generation
9
+ ---
10
+ # Model Card for TarsDolly
11
+
12
+ ## Model Details
13
+
14
+ TarsDolly is FT on HuggingFaceH4/zephyr-7b-alpha using Dolly-15k dataset for general chat.
15
+
16
+ #### Preprocessing
17
+
18
+ Dolly-15k dataset was converted into chatml style for futher FT on zephyr-7b-beta model
19
+
20
+ #### Training Hyperparameters
21
+
22
+ epochs 4
23
+ batch_size 1
24
+ block_size 2096
25
+ lr 2e-4