license: llama3 | |
library_name: transformers | |
pipeline_tag: text-generation | |
# Llama3-OpenBioLLM-8B-GGUF | |
This is quantized version of [aaditya/Llama3-OpenBioLLM-8B](https://huggingface.co/aaditya/Llama3-OpenBioLLM-8B) created using llama.cpp | |
## Available Quants | |
* Q2_K | |
* Q3_K_L | |
* Q3_K_M | |
* Q3_K_S | |
* Q4_0 | |
* Q4_1 | |
* Q4_K_M | |
* Q4_K_S | |
* Q5_0 | |
* Q5_1 | |
* Q5_K_M | |
* Q5_K_S | |
* Q6_K | |
* Q8_0 |