afrideva
/

tiny-llama-1.1b-chat-medical-GGUF

+---
+base_model: SumayyaAli/tiny-llama-1.1b-chat-medical
+datasets:
+- SumayyaAli/accu_qa_dataset
+inference: false
+language:
+- en
+model_creator: SumayyaAli
+model_name: tiny-llama-1.1b-chat-medical
+pipeline_tag: text-generation
+quantized_by: afrideva
+tags:
+- medical
+- gguf
+- ggml
+- quantized
+- q2_k
+- q3_k_m
+- q4_k_m
+- q5_k_m
+- q6_k
+- q8_0
+---
+# SumayyaAli/tiny-llama-1.1b-chat-medical-GGUF
+Quantized GGUF model files for [tiny-llama-1.1b-chat-medical](https://huggingface.co/SumayyaAli/tiny-llama-1.1b-chat-medical) from [SumayyaAli](https://huggingface.co/SumayyaAli)
+| Name | Quant method | Size |
+| ---- | ---- | ---- |
+| [tiny-llama-1.1b-chat-medical.fp16.gguf](https://huggingface.co/afrideva/tiny-llama-1.1b-chat-medical-GGUF/resolve/main/tiny-llama-1.1b-chat-medical.fp16.gguf) | fp16 | 2.20 GB  |
+| [tiny-llama-1.1b-chat-medical.q2_k.gguf](https://huggingface.co/afrideva/tiny-llama-1.1b-chat-medical-GGUF/resolve/main/tiny-llama-1.1b-chat-medical.q2_k.gguf) | q2_k | 483.12 MB  |
+| [tiny-llama-1.1b-chat-medical.q3_k_m.gguf](https://huggingface.co/afrideva/tiny-llama-1.1b-chat-medical-GGUF/resolve/main/tiny-llama-1.1b-chat-medical.q3_k_m.gguf) | q3_k_m | 550.82 MB  |
+| [tiny-llama-1.1b-chat-medical.q4_k_m.gguf](https://huggingface.co/afrideva/tiny-llama-1.1b-chat-medical-GGUF/resolve/main/tiny-llama-1.1b-chat-medical.q4_k_m.gguf) | q4_k_m | 668.79 MB  |
+| [tiny-llama-1.1b-chat-medical.q5_k_m.gguf](https://huggingface.co/afrideva/tiny-llama-1.1b-chat-medical-GGUF/resolve/main/tiny-llama-1.1b-chat-medical.q5_k_m.gguf) | q5_k_m | 783.02 MB  |
+| [tiny-llama-1.1b-chat-medical.q6_k.gguf](https://huggingface.co/afrideva/tiny-llama-1.1b-chat-medical-GGUF/resolve/main/tiny-llama-1.1b-chat-medical.q6_k.gguf) | q6_k | 904.39 MB  |
+| [tiny-llama-1.1b-chat-medical.q8_0.gguf](https://huggingface.co/afrideva/tiny-llama-1.1b-chat-medical-GGUF/resolve/main/tiny-llama-1.1b-chat-medical.q8_0.gguf) | q8_0 | 1.17 GB  |
+## Original Model Card: