Hugging Face's logo

DanielClough
/
Candle_phi-2

Text Generation
Transformers
Safetensors
GGUF
English
phi
custom_code
Inference Endpoints
text-generation-inference
Model card Files Community
danielclough commited on
Commit
ce811cc
•
1 Parent(s): 8cc5c42

add gguf

Browse files
Files changed (13) hide show
  1. Candle_phi-2_f16.gguf +3 -0
  2. Candle_phi-2_q2k.gguf +3 -0
  3. Candle_phi-2_q3k.gguf +3 -0
  4. Candle_phi-2_q4_0.gguf +3 -0
  5. Candle_phi-2_q4_1.gguf +3 -0
  6. Candle_phi-2_q4k.gguf +3 -0
  7. Candle_phi-2_q5_0.gguf +3 -0
  8. Candle_phi-2_q5_1.gguf +3 -0
  9. Candle_phi-2_q5k.gguf +3 -0
  10. Candle_phi-2_q6k.gguf +3 -0
  11. Candle_phi-2_q8_0.gguf +3 -0
  12. Candle_phi-2_q8_1.gguf +3 -0
  13. Candle_phi-2_q8k.gguf +3 -0
Candle_phi-2_f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdf5ec69cdc0ee8eb1c371819df162641658bf3c9f762f206b1e0650e6c9c95c
3
+ size 5561314368
Candle_phi-2_q2k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:636a82d9bdff8c5d7ad0bc2d3c54c8a27df3d16c54a9b2ddb9d2f46c7628849d
3
+ size 915631168
Candle_phi-2_q3k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f20bce439a649ebfd37846e8105f2afae31b4fee367f3371096e425a519d0391
3
+ size 1197845568
Candle_phi-2_q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b304bbb1d6358fcf9c4d1977567e98cc11a3fe87ee15b06b87910e3ac41ae59b
3
+ size 1566895168
Candle_phi-2_q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fc793dba0c5d84775adb6533adfdcf5455a211dc72f67644ef5dccbe91ce5d4
3
+ size 1740565568
Candle_phi-2_q4k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da1f729c61a1d74c967ec23dd06e2009df103a502ec6601fa02f8b378d57bbb0
3
+ size 1566895168
Candle_phi-2_q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41dfcfb5301520fa2ba53b3dbd653a123186602c8239e1a68ae87445a9ae161e
3
+ size 1914235968
Candle_phi-2_q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2eb64a951a41fdc19c99862d8d45a8377b4d4934d09bd38f261b23b8d6a392f
3
+ size 2087906368
Candle_phi-2_q5k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6813ba7a7583368e85e21ec878085aa97065de9cdc8985357db32ef8729bb477
3
+ size 1914235968
Candle_phi-2_q6k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efa433b2f328661f50b853d21563ab2a42257e9f109c9edbaf7465ebb41bccef
3
+ size 2283285568
Candle_phi-2_q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9086c2613ae11b016ddbdd2296afcacde8ed94c51063ac7751ab77d1da0edb1a
3
+ size 2956258368
Candle_phi-2_q8_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e8d3a727ff651fc2b496f4be7c249bd52f4d96c79a5e27496d592ff2c7c82e9
3
+ size 3129928768
Candle_phi-2_q8k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ac9752d3aa23eaff40d39cba25bacc3989a6950fef6f0ed2d167eebd1e8fda1
3
+ size 3173346368