munish0838 commited on
Commit
ce33afa
1 Parent(s): 920aa1b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -5,4 +5,21 @@ pipeline_tag: text-generation
5
  ---
6
 
7
  # Llama3-OpenBioLLM-8B-GGUF
8
- This is quantized version of [aaditya/Llama3-OpenBioLLM-8B](https://huggingface.co/aaditya/Llama3-OpenBioLLM-8B)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  # Llama3-OpenBioLLM-8B-GGUF
8
+ This is quantized version of [aaditya/Llama3-OpenBioLLM-8B](https://huggingface.co/aaditya/Llama3-OpenBioLLM-8B) created using llama.cpp
9
+
10
+ ## Available Quants
11
+
12
+ * Q2_K
13
+ * Q3_K_L
14
+ * Q3_K_M
15
+ * Q3_K_S
16
+ * Q4_0
17
+ * Q4_1
18
+ * Q4_K_M
19
+ * Q4_K_S
20
+ * Q5_0
21
+ * Q5_1
22
+ * Q5_K_M
23
+ * Q5_K_S
24
+ * Q6_K
25
+ * Q8_0