oshizo
/

japanese-e5-mistral-7b_slerp

Sentence Similarity

feature-extraction

text-generation-inference

text-embeddings-inference

Inference Endpoints

Model card Files Files and versions Community

oshizo commited on Jan 5

Commit

6c516b8

•

1 Parent(s): 254744c

Update README.md

Files changed (1) hide show

README.md +3 -6

README.md CHANGED Viewed

@@ -35,11 +35,7 @@ models:
 base_model: stabilityai/japanese-stablelm-base-gamma-7b
 parameters:
   t:
-    - filter: self_attn
-      value: [0.75, 0.25]
-    - filter: mlp
-      value: [0.75, 0.25]
-    - value: 0.5 # fallback for rest of tensors
 merge_method: slerp
 dtype: float16
@@ -55,4 +51,5 @@ As for the "ties" method, I could not find any parameters for density and weight
 * config.json
 * tokenizer.json
 * tokenizer.model
-* tokenizer_config.json

 base_model: stabilityai/japanese-stablelm-base-gamma-7b
 parameters:
   t:
+    - value: [0.5, 0.9]
 merge_method: slerp
 dtype: float16
 * config.json
 * tokenizer.json
 * tokenizer.model
+* tokenizer_config.json
+* special_tokens_map.json