Hugging Face's logo

Zoyd
/
mlabonne_NeuralDaredevil-8B-abliterated-6_5bpw_exl2

Text Generation
Transformers
Safetensors
llama
dpo
text-generation-inference
Inference Endpoints
exl2
Model card Files Community
Edit model card
Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Exllamav2 quant (exl2 / 6.5 bpw) made with ExLlamaV2 v0.1.1

Other EXL2 quants:

Quant Model Size lm_head
2.2
3250 MB
6
2.5
3479 MB
6
3.0
3895 MB
6
3.5
4310 MB
6
3.75
4519 MB
6
4.0
4727 MB
6
4.25
4931 MB
6
5.0
5559 MB
6
6.0
6495 MB
8
6.5
6903 MB
8
8.0
8157 MB
8

NeuralDaredevil-8B-abliterated

image/jpeg

This is a DPO fine-tune of mlabonne/Daredevil-8-abliterated trained on one epoch of mlabonne/orpo-dpo-mix-40k.

🏆 Evaluation

Open LLM Leaderboard

TBD.

Nous

Evaluation performed using LLM AutoEval. See the entire leaderboard here.

Model Average AGIEval GPT4All TruthfulQA Bigbench
mlabonne/NeuralDaredevil-8B-abliterated 📄 55.87 43.73 73.6 59.36 46.8
mlabonne/Daredevil-8B 📄 55.87 44.13 73.52 59.05 46.77
mlabonne/Daredevil-8B-abliterated 📄 55.06 43.29 73.33 57.47 46.17
NousResearch/Hermes-2-Theta-Llama-3-8B 📄 54.28 43.9 72.62 56.36 44.23
openchat/openchat-3.6-8b-20240522 📄 53.49 44.03 73.67 49.78 46.48
meta-llama/Meta-Llama-3-8B-Instruct 📄 51.34 41.22 69.86 51.65 42.64
meta-llama/Meta-Llama-3-8B 📄 45.42 31.1 69.95 43.91 36.7

🌳 Model family tree

image/png

Downloads last month
3
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-6_5bpw_exl2