Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
File size: 2,049 Bytes
66b2053
 
 
 
 
 
 
 
 
 
 
8749fd6
e9d2bcb
 
 
 
 
 
 
 
 
 
9db251f
e9d2bcb
 
 
9db251f
e9d2bcb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
---
license: llama3
datasets:
- lodrick-the-lafted/OpusStories
- lodrick-the-lafted/Sao10K_Claude-3-Opus-Instruct-3.3K
- lodrick-the-lafted/Samantha-Opus
- lodrick-the-lafted/Worldsim-Opus
---

<img src=https://huggingface.co/lodrick-the-lafted/Olethros-8B/resolve/main/olethros.png>

# Olethros-8B

L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.

<br />
<br />

<br />
<br />

# Quants
GGUF, Exl2 and AWQ available right now.

| Type  | Misc   | Author        |
| ----- | -----  | -----         |
[GGUF](https://huggingface.co/mradermacher/Olethros-8B-GGUF)| Static GGUF Quants | mradermacher |
[AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)|        | lodrick   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)|  2.25bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)|  2.5bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3-exl2)|  3.0bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3.5-exl2)|  3.5bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3.7-exl2)|  3.7bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4-exl2)|  4.0bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.2-exl2)|  4.2bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.4-exl2)|  4.4bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.6-exl2)|  4.6bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.8-exl2)|  4.8bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw5-exl2)|  5.0bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw5.5-exl2)|  5.5bpw | blockblockblock   |
[exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw6-exl2)|  6.0bpw | blockblockblock   |