Xenova
/

Phi-3-mini-4k-instruct-hf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

fp16 KV I/O for q4 model

#3

by Xenova HF staff - opened May 16

base: refs/heads/main

←

from: refs/pr/3

Discussion Files changed

Files changed (1) hide show

onnx/model_q4f16.onnx +2 -2

onnx/model_q4f16.onnx CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dd9589b8d4724727ebe574e56dcb7e13dce84533de953a5b830c8708adeca854
-size 1240708766

 version https://git-lfs.github.com/spec/v1
+oid sha256:d703e1223828610da52dfb6e35f38bc50e7b6f4a7f270c91b170f02088112623
+size 1240688216