---
license: llama3
datasets:
- lodrick-the-lafted/OpusStories
- lodrick-the-lafted/Sao10K_Claude-3-Opus-Instruct-3.3K
- lodrick-the-lafted/Samantha-Opus
- lodrick-the-lafted/Worldsim-Opus
---

<img src=https://huggingface.co/lodrick-the-lafted/Olethros-8B/resolve/main/olethros.png>

# Olethros-8B-AWQ

L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.

This is the 4 bit, group size 128 AWQ quant. 

<br />
<br />

[original model weights](https://huggingface.co/lodrick-the-lafted/Olethros-8B) are here.

<br />
<br />

# Quants
Exl2 and AWQ available right now.

| Type  | Misc   | Author        |
| ----- | -----  | -----         |
[GGUF](https://huggingface.co/mradermacher/Olethros-8B-GGUF)| Static GGUF Quants | mradermacher |
[AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)|        | lodrick   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)|  2.25bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)|  2.5bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3-exl2)|  3.0bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3.5-exl2)|  3.5bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3.7-exl2)|  3.7bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4-exl2)|  4.0bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.2-exl2)|  4.2bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.4-exl2)|  4.4bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.6-exl2)|  4.6bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.8-exl2)|  4.8bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw5-exl2)|  5.0bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw5.5-exl2)|  5.5bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw6-exl2)|  6.0bpw | blockblockblock   |