mradermacher commited on
Commit
c906606
1 Parent(s): d597a29

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -7,9 +7,17 @@ quantized_by: mradermacher
7
  tags:
8
  - text-generation-inference
9
  ---
10
- static quantize of https://huggingface.co/Doctor-Shotgun/mythospice-70b
11
 
 
12
  <!-- provided-files -->
 
 
 
 
 
 
 
13
  ## Provided Quants
14
 
15
  | Link | Type | Size/GB | Notes |
@@ -26,4 +34,5 @@ static quantize of https://huggingface.co/Doctor-Shotgun/mythospice-70b
26
  | [PART 1](https://huggingface.co/mradermacher/mythospice-70b-GGUF/resolve/main/mythospice-70b.Q6_K.gguf.split-aa) [PART 2](https://huggingface.co/mradermacher/mythospice-70b-GGUF/resolve/main/mythospice-70b.Q6_K.gguf.split-ab) | Q6_K | 56.6 | very good quality |
27
  | [PART 1](https://huggingface.co/mradermacher/mythospice-70b-GGUF/resolve/main/mythospice-70b.Q8_0.gguf.split-aa) [PART 2](https://huggingface.co/mradermacher/mythospice-70b-GGUF/resolve/main/mythospice-70b.Q8_0.gguf.split-ab) | Q8_0 | 73.3 | fast, best quality |
28
 
 
29
  <!-- end -->
 
7
  tags:
8
  - text-generation-inference
9
  ---
10
+ ## About
11
 
12
+ static quantize of https://huggingface.co/Doctor-Shotgun/mythospice-70b
13
  <!-- provided-files -->
14
+
15
+ ## Usage
16
+
17
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
18
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
19
+ more details, including on how to concatenate multi-part files.
20
+
21
  ## Provided Quants
22
 
23
  | Link | Type | Size/GB | Notes |
 
34
  | [PART 1](https://huggingface.co/mradermacher/mythospice-70b-GGUF/resolve/main/mythospice-70b.Q6_K.gguf.split-aa) [PART 2](https://huggingface.co/mradermacher/mythospice-70b-GGUF/resolve/main/mythospice-70b.Q6_K.gguf.split-ab) | Q6_K | 56.6 | very good quality |
35
  | [PART 1](https://huggingface.co/mradermacher/mythospice-70b-GGUF/resolve/main/mythospice-70b.Q8_0.gguf.split-aa) [PART 2](https://huggingface.co/mradermacher/mythospice-70b-GGUF/resolve/main/mythospice-70b.Q8_0.gguf.split-ab) | Q8_0 | 73.3 | fast, best quality |
36
 
37
+
38
  <!-- end -->