Steelskull commited on
Commit
74c799e
1 Parent(s): 16b566e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -9,13 +9,14 @@ tags:
9
 
10
  # Aurora_base_test
11
 
12
- Aurora_base_test is a merge of the following models: to create a 10.7b base model that can be trained.
13
  * [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
14
  * [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
15
 
16
  ## 🧩 Configuration
17
 
18
- ```yamlslices:
 
19
  - sources:
20
  - model: mistralai/Mistral-7B-Instruct-v0.2
21
  layer_range: [0, 24]
@@ -23,7 +24,8 @@ Aurora_base_test is a merge of the following models: to create a 10.7b base mode
23
  - model: mistralai/Mistral-7B-Instruct-v0.2
24
  layer_range: [8, 32]
25
  merge_method: passthrough
26
- dtype: bfloat16```
 
27
 
28
  ## 💻 Usage
29
 
 
9
 
10
  # Aurora_base_test
11
 
12
+ Aurora_base is a merge of the following models: to create a 10.7b base model that can be trained.
13
  * [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
14
  * [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
15
 
16
  ## 🧩 Configuration
17
 
18
+ ```
19
+ slices:
20
  - sources:
21
  - model: mistralai/Mistral-7B-Instruct-v0.2
22
  layer_range: [0, 24]
 
24
  - model: mistralai/Mistral-7B-Instruct-v0.2
25
  layer_range: [8, 32]
26
  merge_method: passthrough
27
+ dtype: bfloat16
28
+ ```
29
 
30
  ## 💻 Usage
31