leaderboard-pr-bot's picture
Adding Evaluation Results
be3aa5c
metadata
license: apache-2.0
datasets:
  - Fredithefish/openassistant-guanaco-unfiltered
language:
  - en
library_name: transformers
pipeline_tag: conversational
inference: false
Alt Text

✨ Guanaco - 13B - Uncensored ✨

Guanaco-13B-Uncensored has been fine-tuned for 4 epochs on the Unfiltered Guanaco Dataset. using Llama-2-13B as the base model.
The model does not perform well with languages other than English.
Please note: This model is designed to provide responses without content filtering or censorship. It generates answers without denials.

Special thanks

I would like to thank AutoMeta for providing me with the computing power necessary to train this model.

Also thanks to TheBloke for creating the GGUF and the GPTQ quantizations for this model

Prompt Template

### Human: {prompt} ### Assistant:

Dataset

The model has been fine-tuned on the V2 of the Guanaco unfiltered dataset.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 47.23
ARC (25-shot) 59.56
HellaSwag (10-shot) 82.7
MMLU (5-shot) 53.65
TruthfulQA (0-shot) 43.26
Winogrande (5-shot) 76.32
GSM8K (5-shot) 9.1
DROP (3-shot) 6.03