leaderboard-pr-bot's picture
Adding Evaluation Results
be3aa5c
---
license: apache-2.0
datasets:
- Fredithefish/openassistant-guanaco-unfiltered
language:
- en
library_name: transformers
pipeline_tag: conversational
inference: false
---
<img src="https://huggingface.co/Fredithefish/Guanaco-3B-Uncensored/resolve/main/Guanaco-Uncensored.jpg" alt="Alt Text" width="295"/>
# ✨ Guanaco - 13B - Uncensored ✨
Guanaco-13B-Uncensored has been fine-tuned for 4 epochs on the [Unfiltered Guanaco Dataset.](https://huggingface.co/datasets/Fredithefish/openassistant-guanaco-unfiltered) using [Llama-2-13B](https://hf.co/meta-llama/Llama-2-13b-hf) as the base model.
<br>The model does not perform well with languages other than English.
<br>Please note: This model is designed to provide responses without content filtering or censorship. It generates answers without denials.
## Special thanks
I would like to thank AutoMeta for providing me with the computing power necessary to train this model.
Also thanks to TheBloke for creating [the GGUF](https://huggingface.co/TheBloke/Guanaco-13B-Uncensored-GGUF) and [the GPTQ](https://huggingface.co/TheBloke/Guanaco-13B-Uncensored-GPTQ) quantizations for this model
### Prompt Template
```
### Human: {prompt} ### Assistant:
```
### Dataset
The model has been fine-tuned on the V2 of the Guanaco unfiltered dataset.
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Fredithefish__Guanaco-13B-Uncensored)
| Metric | Value |
|-----------------------|---------------------------|
| Avg. | 47.23 |
| ARC (25-shot) | 59.56 |
| HellaSwag (10-shot) | 82.7 |
| MMLU (5-shot) | 53.65 |
| TruthfulQA (0-shot) | 43.26 |
| Winogrande (5-shot) | 76.32 |
| GSM8K (5-shot) | 9.1 |
| DROP (3-shot) | 6.03 |