SkunkworksAI
/

tinyfrank-1.4B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

nisten commited on Dec 31, 2023

Commit

e22676e

•

1 Parent(s): b76e381

Update README.md

fixed the secret sauce menu

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -14,10 +14,10 @@ The secret sauce:
 slices:
   - sources:
     - model: "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
-      layer_range: [0, 22]
   - sources:
     - model: "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
-      layer_range: [8, 32]
 merge_method: passthrough
 dtype: bfloat16
 ```

 slices:
   - sources:
     - model: "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
+      layer_range: [0, 14]
   - sources:
     - model: "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
+      layer_range: [8, 22]
 merge_method: passthrough
 dtype: bfloat16
 ```