Hugging Face's logo

mradermacher
/
GOAT-70B-Storytelling-i1-GGUF

Transformers
GGUF
PyTorch
English
facebook
meta
llama
llama-2
Storywriter
Inference Endpoints
Model card Files Community
1
mradermacher commited on
Commit
a7408f4
•
1 Parent(s): 069ab55

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +35 -1
README.md CHANGED
@@ -1 +1,35 @@
1
- weighted/imatrix quants of https://huggingface.co/GOAT-AI/GOAT-70B-Storytelling
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ library_name: transformers
5
+ license: llama2
6
+ model_type: llama
7
+ quantized_by: mradermacher
8
+ tags:
9
+ - facebook
10
+ - meta
11
+ - pytorch
12
+ - llama
13
+ - llama-2
14
+ - Storywriter
15
+ ---
16
+ weighted/imatrix quants of https://huggingface.co/GOAT-AI/GOAT-70B-Storytelling
17
+
18
+ <!-- provided-files -->
19
+ ## Provided Quants
20
+
21
+ | Link | Type | Size/GB | Notes |
22
+ |:-----|:-----|--------:|:------|
23
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-IQ1_S.gguf) | i1-IQ1_S | 14.9 | |
24
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 18.6 | |
25
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-IQ2_XS.gguf) | i1-IQ2_XS | 20.7 | |
26
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-Q2_K.gguf) | i1-Q2_K | 25.8 | |
27
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 27.3 | fast, lower quality |
28
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-Q3_K_XS.gguf) | i1-Q3_K_XS | 28.6 | IQ3-XXS probably better |
29
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-Q3_K_S.gguf) | i1-Q3_K_S | 30.2 | IQ3-XXS probably better |
30
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-Q3_K_M.gguf) | i1-Q3_K_M | 33.6 | lower quality |
31
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-Q3_K_L.gguf) | i1-Q3_K_L | 36.5 | |
32
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-Q4_K_S.gguf) | i1-Q4_K_S | 39.6 | fast, medium quality |
33
+ | [GGUF](https://huggingface.co/mradermacher/GOAT-70B-Storytelling-i1-GGUF/resolve/main/GOAT-70B-Storytelling.i1-Q4_K_M.gguf) | i1-Q4_K_M | 41.7 | fast, medium quality |
34
+
35
+ <!-- end -->