bn22
/

tinyllama_frankenmerge

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

bn22 commited on Jan 8

Commit

68b78e8

•

1 Parent(s): 0093afe

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -22,4 +22,5 @@ slices:
     - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
       layer_range: [6, 22]
 merge_method: passthrough
-dtype: float16```

     - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
       layer_range: [6, 22]
 merge_method: passthrough
+dtype: float16
+```