Hugging Face's logo

second-state
/
Phi-3-mini-4k-instruct-GGUF

Text Generation
Transformers
GGUF
English
phi3
nlp
code
custom_code
Inference Endpoints
Model card Files Community
Xin Liu commited on
Commit
fecbb67
•
1 Parent(s): e4e502d

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. Phi-3-mini-4k-instruct-Q2_K.gguf +3 -0
  2. Phi-3-mini-4k-instruct-Q3_K_L.gguf +3 -0
  3. Phi-3-mini-4k-instruct-Q3_K_M.gguf +3 -0
  4. Phi-3-mini-4k-instruct-Q3_K_S.gguf +3 -0
  5. Phi-3-mini-4k-instruct-Q4_0.gguf +3 -0
  6. Phi-3-mini-4k-instruct-Q4_K_M.gguf +3 -0
  7. Phi-3-mini-4k-instruct-Q4_K_S.gguf +3 -0
  8. Phi-3-mini-4k-instruct-Q5_0.gguf +3 -0
  9. Phi-3-mini-4k-instruct-Q5_K_M.gguf +3 -0
  10. Phi-3-mini-4k-instruct-Q5_K_S.gguf +3 -0
  11. Phi-3-mini-4k-instruct-Q6_K.gguf +3 -0
  12. Phi-3-mini-4k-instruct-Q8_0.gguf +3 -0
  13. Phi-3-mini-4k-instruct-f16.gguf +3 -0
Phi-3-mini-4k-instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d827ee57632ec3680951550e3c8a08b749ba48cff7bcf840d7bf5a68c67d99db
3
+ size 1416202912
Phi-3-mini-4k-instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce340d0ba94846326dd01951c2e3199027028aa021abc2c9ca90e5ffe08cca07
3
+ size 2087596192
Phi-3-mini-4k-instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c3dbf76b07a9f1a792cdd3bf29e4204ddb229287e301a01f2873ddfcd2d4f29
3
+ size 1955475616
Phi-3-mini-4k-instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d969985fac8f7da02fc464ed52405289e1f9682f29e24494354bd8f0fa612d3
3
+ size 1681797280
Phi-3-mini-4k-instruct-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f50649e74c67ec154fee88cf89966640196a360a3f3a0c90c548263b7e7cf71
3
+ size 2176175776
Phi-3-mini-4k-instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07c46c4f7fbc286417be8a61ee1b45094ff30b5be8039e67fb403b102dc8838f
3
+ size 2393231008
Phi-3-mini-4k-instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f3df621f2fe5da21b4802001e910ac279e0d1409d90fabec0d77bdc9b294ca8
3
+ size 2188758688
Phi-3-mini-4k-instruct-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10dd25f058c9d246c67e77d16549ef13f65dbcc3d6e9300b43fabcbff777a1ef
3
+ size 2641473184
Phi-3-mini-4k-instruct-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed4479317c3d28c3b7fe68f21176cd2a1b8862cc6ee89934a2defec9f502fa50
3
+ size 2815274656
Phi-3-mini-4k-instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:231d5c9a40d3819c5b2186eda00592e56938dac81b0c9b0ad084f4f87ef619be
3
+ size 2641473184
Phi-3-mini-4k-instruct-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d1050a276cac7381eba4bd790254d66c8441d862370dbba2f490c71139221be
3
+ size 3135851680
Phi-3-mini-4k-instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d2f3732e31c354e169cd81dcde9807a1c73b85b9a0f9b16c19013e7a4bb151c
3
+ size 4061221024
Phi-3-mini-4k-instruct-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3151f5fa15470cfdefe94f17add74a0a9a7fdbef640db236487a21c110650203
3
+ size 7643295840