Kquant03 commited on
Commit
798f6df
1 Parent(s): bda5b7c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -12,7 +12,7 @@ thumbnail: "https://cdn-uploads.huggingface.co/production/uploads/6589d7e6586088
12
 
13
  [Elothir](https://wowpedia.fandom.com/wiki/Elothir) was an ancient treeant, and I couldn't think of a better naming convention for a model that was created using the passthrough method.
14
 
15
- The passthrough method differs significantly from the previous ones. By concatenating layers from different LLMs, it can produce models with an exotic number of parameters (e.g., 9B with two 7B parameter models). These models are often referred to as "frankenmerges" or "Frankenstein models" by the community.
16
 
17
 
18
  Many thanks to [Abacaj](https://huggingface.co/abacaj) for providing the [fine tuned weights](https://huggingface.co/abacaj/phi-2-super) that were used in the creation of this base model. You can find the full script for how the model was merged [here](https://huggingface.co/Replete-AI/Phi-Elothir/blob/main/mergekit_config.yml)...thanks to [KatyTheCutie](https://huggingface.co/KatyTheCutie) for inspring me to test out this script.
 
12
 
13
  [Elothir](https://wowpedia.fandom.com/wiki/Elothir) was an ancient treeant, and I couldn't think of a better naming convention for a model that was created using the passthrough method.
14
 
15
+ By concatenating layers from different LLMs, it can produce models with an exotic number of parameters (e.g., 9B with two 7B parameter models). These models are often referred to as "frankenmerges" or "Frankenstein models" by the community.
16
 
17
 
18
  Many thanks to [Abacaj](https://huggingface.co/abacaj) for providing the [fine tuned weights](https://huggingface.co/abacaj/phi-2-super) that were used in the creation of this base model. You can find the full script for how the model was merged [here](https://huggingface.co/Replete-AI/Phi-Elothir/blob/main/mergekit_config.yml)...thanks to [KatyTheCutie](https://huggingface.co/KatyTheCutie) for inspring me to test out this script.