lodrick-the-lafted
/

Olethros-8B-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

lodrick-the-lafted commited on Apr 29

Commit

0e8e5c7

•

1 Parent(s): 9160f7e

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -28,6 +28,7 @@ Exl2 and AWQ available right now.
 | Type  | Misc   | Author        |
 | ----- | -----  | -----         |
 [AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)|        | lodrick   |
 [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)|  2.25bpw | blockblockblock   |
 [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)|  2.5bpw | blockblockblock   |

 | Type  | Misc   | Author        |
 | ----- | -----  | -----         |
+[GGUF](https://huggingface.co/mradermacher/Olethros-8B-GGUF)| Static GGUF Quants | mradermacher |
 [AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)|        | lodrick   |
 [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)|  2.25bpw | blockblockblock   |
 [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)|  2.5bpw | blockblockblock   |