CultriX
/

OptiMerged7B

Text Generation

mlabonne/AlphaMonarch-7B

mlabonne/NeuralMonarch-7B

Kukedlc/NeuralMaxime-7B-slerp

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

CultriX commited on Mar 19

Commit

784131e

•

1 Parent(s): 29f47e8

Upload folder using huggingface_hub

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -23,14 +23,14 @@ OptiMerged7B is a merge of the following models using [LazyMergekit](https://col
 ```yaml
 models:
-  - model: CultriX/MonaTrix-v4
     # No parameters necessary for base model
-  - model: mlabonne/AlphaMonarch-7B
     #Emphasize the beginning of Vicuna format models
     parameters:
       weight: 0.63
       density: 0.42
-  - model: mlabonne/NeuralMonarch-7B
     parameters:
       weight: 0.35
       density: 0.61
@@ -40,7 +40,7 @@ models:
       weight: 0.32
       density: 0.6
 merge_method: dare_ties
-base_model: CultriX/MonaTrix-v4
 parameters:
   int8_mask: true
 dtype: bfloat16

 ```yaml
 models:
+  - model: CultriX/MonaTrix-v4
     # No parameters necessary for base model
+  - model: mlabonne/AlphaMonarch-7B
     #Emphasize the beginning of Vicuna format models
     parameters:
       weight: 0.63
       density: 0.42
+  - model: mlabonne/NeuralMonarch-7B
     parameters:
       weight: 0.35
       density: 0.61
       weight: 0.32
       density: 0.6
 merge_method: dare_ties
+base_model: CultriX/MonaTrix-v4
 parameters:
   int8_mask: true
 dtype: bfloat16