Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
Locutusque bartowski commited on
Commit
5b8317b
1 Parent(s): a506ff0

Add quant links (#5)

Browse files

- Add quant links (67c35240d2a947cdc28d4dc5fcfd76c8c66b40f6)


Co-authored-by: Bartowski <bartowski@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -31,6 +31,16 @@ I fine-tuned llama-3 8B on mainly SlimOrca, along with other datasets to improve
31
  - **Language(s) (NLP):** Many?
32
  - **License:** Llama 3 license https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE
33
 
 
 
 
 
 
 
 
 
 
 
34
  ## Uses
35
 
36
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
 
31
  - **Language(s) (NLP):** Many?
32
  - **License:** Llama 3 license https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE
33
 
34
+ ## Quants
35
+
36
+ ### EXL2 [@bartowski](https://huggingface.co/bartowski/)
37
+
38
+ - https://huggingface.co/bartowski/Llama-3-Orca-1.0-8B-exl2
39
+
40
+ ### GGUF [@bartowski](https://huggingface.co/bartowski/)
41
+
42
+ - https://huggingface.co/bartowski/Llama-3-Orca-1.0-8B-GGUF
43
+
44
  ## Uses
45
 
46
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->