legraphista commited on
Commit
d60b6ea
β€’
1 Parent(s): 8cdab80

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -30,7 +30,7 @@ tags:
30
  # K2-ckpt_360-IMat-GGUF
31
  _Llama.cpp imatrix quantization of LLM360/K2_
32
 
33
- Original Model: [LLM360/K2](https://huggingface.co/LLM360/K2)
34
  Original dtype: `FP16` (`float16`)
35
  Quantized by: llama.cpp [b3058](https://github.com/ggerganov/llama.cpp/releases/tag/b3058)
36
  IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dccb3571f863da82e99418f81e8/raw/b2869d80f5c16fd7082594248e80144677736635/calibration_datav3.txt)
@@ -67,7 +67,7 @@ Link: [here](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/blob/main/
67
  ### All Quants
68
  | Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
69
  | -------- | ---------- | --------- | ------ | ------------ | -------- |
70
- | K2-ckpt_360.FP16 | F16 | - | ⏳ Processing | βšͺ Static | -
71
  | [K2-ckpt_360.Q8_0/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.Q8_0) | Q8_0 | 69.37GB | βœ… Available | βšͺ Static | βœ‚ Yes
72
  | [K2-ckpt_360.Q6_K/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.Q6_K) | Q6_K | 53.56GB | βœ… Available | βšͺ Static | βœ‚ Yes
73
  | K2-ckpt_360.Q5_K | Q5_K | - | ⏳ Processing | βšͺ Static | -
 
30
  # K2-ckpt_360-IMat-GGUF
31
  _Llama.cpp imatrix quantization of LLM360/K2_
32
 
33
+ Original Model: [LLM360/K2](https://huggingface.co/LLM360/K2/tree/ckpt_360) branch `ckpt_360`
34
  Original dtype: `FP16` (`float16`)
35
  Quantized by: llama.cpp [b3058](https://github.com/ggerganov/llama.cpp/releases/tag/b3058)
36
  IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dccb3571f863da82e99418f81e8/raw/b2869d80f5c16fd7082594248e80144677736635/calibration_datav3.txt)
 
67
  ### All Quants
68
  | Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
69
  | -------- | ---------- | --------- | ------ | ------------ | -------- |
70
+ | [K2-ckpt_360.FP16/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.FP16) | F16 | 130.58GB | βœ… Available | βšͺ Static | βœ‚ Yes
71
  | [K2-ckpt_360.Q8_0/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.Q8_0) | Q8_0 | 69.37GB | βœ… Available | βšͺ Static | βœ‚ Yes
72
  | [K2-ckpt_360.Q6_K/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.Q6_K) | Q6_K | 53.56GB | βœ… Available | βšͺ Static | βœ‚ Yes
73
  | K2-ckpt_360.Q5_K | Q5_K | - | ⏳ Processing | βšͺ Static | -