lodrick-the-lafted
/

Olethros-8B

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

lodrick-the-lafted commited on Apr 29

Commit

9db251f

•

1 Parent(s): 8749fd6

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -20,10 +20,11 @@ L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a b
 <br />
 # Quants
-Exl2 and AWQ available right now.
 | Type  | Misc   | Author        |
 | ----- | -----  | -----         |
 [AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)|        | lodrick   |
 [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)|  2.25bpw | blockblockblock   |
 [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)|  2.5bpw | blockblockblock   |

 <br />
 # Quants
+GGUF, Exl2 and AWQ available right now.
 | Type  | Misc   | Author        |
 | ----- | -----  | -----         |
+[GGUF](https://huggingface.co/mradermacher/Olethros-8B-GGUF)| Static GGUF Quants | mradermacher |
 [AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)|        | lodrick   |
 [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)|  2.25bpw | blockblockblock   |
 [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)|  2.5bpw | blockblockblock   |