Olethros-8B

L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.

Quants

GGUF, Exl2 and AWQ available right now.

Type	Misc	Author
GGUF	Static GGUF Quants	mradermacher
AWQ		lodrick
exl2	2.25bpw	blockblockblock
exl2	2.5bpw	blockblockblock
exl2	3.0bpw	blockblockblock
exl2	3.5bpw	blockblockblock
exl2	3.7bpw	blockblockblock
exl2	4.0bpw	blockblockblock
exl2	4.2bpw	blockblockblock
exl2	4.4bpw	blockblockblock
exl2	4.6bpw	blockblockblock
exl2	4.8bpw	blockblockblock
exl2	5.0bpw	blockblockblock
exl2	5.5bpw	blockblockblock
exl2	6.0bpw	blockblockblock