Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
Olethros-8B / README.md
lodrick-the-lafted's picture
Update README.md
9db251f verified
---
license: llama3
datasets:
- lodrick-the-lafted/OpusStories
- lodrick-the-lafted/Sao10K_Claude-3-Opus-Instruct-3.3K
- lodrick-the-lafted/Samantha-Opus
- lodrick-the-lafted/Worldsim-Opus
---
<img src=https://huggingface.co/lodrick-the-lafted/Olethros-8B/resolve/main/olethros.png>
# Olethros-8B
L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.
<br />
<br />
<br />
<br />
# Quants
GGUF, Exl2 and AWQ available right now.
| Type | Misc | Author |
| ----- | ----- | ----- |
[GGUF](https://huggingface.co/mradermacher/Olethros-8B-GGUF)| Static GGUF Quants | mradermacher |
[AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)| | lodrick |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)| 2.25bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)| 2.5bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3-exl2)| 3.0bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3.5-exl2)| 3.5bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3.7-exl2)| 3.7bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4-exl2)| 4.0bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.2-exl2)| 4.2bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.4-exl2)| 4.4bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.6-exl2)| 4.6bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.8-exl2)| 4.8bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw5-exl2)| 5.0bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw5.5-exl2)| 5.5bpw | blockblockblock |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw6-exl2)| 6.0bpw | blockblockblock |