QuantFactory/Llama3.1-Allades-8B-GGUF

This is quantized version of nbeerbower/Llama3.1-Allades-8B created using llama.cpp

Original Model Card

Allades finetunes abliterated Llama 3.1 with 5 datasets to improve creative writing, reasoning, and roleplay.

ORPO tuned for 1 epoch with 2x RTX 3090 (sponsored by Schneewolf Labs).

Data was prepared with Llama 3.1 Instruct.

GGUF

Model size

8.03B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Base model

Finetuned

Finetuned

Quantized

(13)

this model