Text Generation
Transformers
Safetensors
English
llama
mergekit
Merge
medical
conversational
Eval Results
Inference Endpoints
text-generation-inference
sethuiyer commited on
Commit
534838c
1 Parent(s): a3a5ea1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -225,6 +225,10 @@ if __name__ == "__main__":
225
 
226
  ```
227
 
 
 
 
 
228
  ## Ollama
229
  This model is now also available on Ollama. You can use it by running the command ```ollama run monotykamary/medichat-llama3``` in your
230
  terminal. If you have limited computing resources, check out this [video](https://www.youtube.com/watch?v=Qa1h7ygwQq8) to learn how to run it on
 
225
 
226
  ```
227
 
228
+ ## Quants
229
+ Thanks to [Quant Factory](https://huggingface.co/QuantFactory), the quantized version of this model is available at [QuantFactory/Medichat-Llama3-8B-GGUF](https://huggingface.co/QuantFactory/Medichat-Llama3-8B-GGUF),
230
+
231
+
232
  ## Ollama
233
  This model is now also available on Ollama. You can use it by running the command ```ollama run monotykamary/medichat-llama3``` in your
234
  terminal. If you have limited computing resources, check out this [video](https://www.youtube.com/watch?v=Qa1h7ygwQq8) to learn how to run it on