Hugging Face's logo

jtatman
/
NeoXMerge_Pythia

Merge
mergekit
EleutherAI/pythia-160m-deduped
Model card Files Community
jtatman commited on
Commit
20dbb2e
•
1 Parent(s): b05fbca

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +0 -4
README.md CHANGED
@@ -11,20 +11,16 @@ tags:
11
  This model is a merge of the following models made with [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
12
  * [EleutherAI/pythia-160m-deduped](https://huggingface.co/EleutherAI/pythia-160m-deduped)
13
  * [EleutherAI/pythia-160m-deduped](https://huggingface.co/EleutherAI/pythia-160m-deduped)
14
- * [EleutherAI/pythia-160m-deduped](https://huggingface.co/EleutherAI/pythia-160m-deduped)
15
 
16
  ## 🧩 Configuration
17
 
18
  ```yaml
19
  slices:
20
  - sources:
21
- - model: EleutherAI/pythia-160m-deduped
22
- layer_range: [0, 3]
23
  - model: EleutherAI/pythia-160m-deduped
24
  layer_range: [0, 3]
25
  - model: EleutherAI/pythia-160m-deduped
26
  layer_range: [0, 11]
27
- merge_method: dare-ties
28
  base_model: EleutherAI/pythia-160m-deduped
29
  parameters:
30
  t:
 
11
  This model is a merge of the following models made with [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
12
  * [EleutherAI/pythia-160m-deduped](https://huggingface.co/EleutherAI/pythia-160m-deduped)
13
  * [EleutherAI/pythia-160m-deduped](https://huggingface.co/EleutherAI/pythia-160m-deduped)
 
14
 
15
  ## 🧩 Configuration
16
 
17
  ```yaml
18
  slices:
19
  - sources:
 
 
20
  - model: EleutherAI/pythia-160m-deduped
21
  layer_range: [0, 3]
22
  - model: EleutherAI/pythia-160m-deduped
23
  layer_range: [0, 11]
 
24
  base_model: EleutherAI/pythia-160m-deduped
25
  parameters:
26
  t: