legraphista
commited on
Commit
β’
7db89ec
1
Parent(s):
0957e2b
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -49,7 +49,7 @@ IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dc
|
|
49 |
## Files
|
50 |
|
51 |
### IMatrix
|
52 |
-
Status:
|
53 |
Link: [here](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/blob/main/imatrix.dat)
|
54 |
|
55 |
### Common Quants
|
@@ -66,10 +66,10 @@ Link: [here](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-ablite
|
|
66 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
67 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
68 |
| [Meta-Llama-3-70B-Instruct-abliterated-v3.5.BF16/*](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/tree/main/Meta-Llama-3-70B-Instruct-abliterated-v3.5.BF16) | BF16 | 141.12GB | β
Available | βͺ Static | β Yes
|
69 |
-
| Meta-Llama-3-70B-Instruct-abliterated-v3.5.FP16 | F16 |
|
70 |
| [Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q8_0/*](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/tree/main/Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q8_0) | Q8_0 | 74.98GB | β
Available | βͺ Static | β Yes
|
71 |
| [Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q6_K/*](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/tree/main/Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q6_K) | Q6_K | 57.89GB | β
Available | βͺ Static | β Yes
|
72 |
-
| Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q5_K | Q5_K |
|
73 |
| Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q5_K_S | Q5_K_S | - | β³ Processing | βͺ Static | -
|
74 |
| Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
75 |
| Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q4_K_S | Q4_K_S | - | β³ Processing | π’ IMatrix | -
|
|
|
49 |
## Files
|
50 |
|
51 |
### IMatrix
|
52 |
+
Status: β
Available
|
53 |
Link: [here](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/blob/main/imatrix.dat)
|
54 |
|
55 |
### Common Quants
|
|
|
66 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
67 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
68 |
| [Meta-Llama-3-70B-Instruct-abliterated-v3.5.BF16/*](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/tree/main/Meta-Llama-3-70B-Instruct-abliterated-v3.5.BF16) | BF16 | 141.12GB | β
Available | βͺ Static | β Yes
|
69 |
+
| [Meta-Llama-3-70B-Instruct-abliterated-v3.5.FP16/*](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/tree/main/Meta-Llama-3-70B-Instruct-abliterated-v3.5.FP16) | F16 | 141.12GB | β
Available | βͺ Static | β Yes
|
70 |
| [Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q8_0/*](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/tree/main/Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q8_0) | Q8_0 | 74.98GB | β
Available | βͺ Static | β Yes
|
71 |
| [Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q6_K/*](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/tree/main/Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q6_K) | Q6_K | 57.89GB | β
Available | βͺ Static | β Yes
|
72 |
+
| [Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q5_K/*](https://huggingface.co/legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF/tree/main/Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q5_K) | Q5_K | 49.95GB | β
Available | βͺ Static | β Yes
|
73 |
| Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q5_K_S | Q5_K_S | - | β³ Processing | βͺ Static | -
|
74 |
| Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
75 |
| Meta-Llama-3-70B-Instruct-abliterated-v3.5.Q4_K_S | Q4_K_S | - | β³ Processing | π’ IMatrix | -
|