Support the Project:
You can send ETH or any BSC-compatible tokens to the following address:0xC37D7670729a5726EA642c7A11C5aaCB36D43dDE
AWQ quants for TeeZee/BigMaid-20B-v1.0.
Original model information by the author:
BigMaid-20B-v1.0
Model Details
- A result of interleaving layers of KatyTheCutie/EstopianMaid-13B with itself.
- The resulting model has approximately 20 billion parameters.
- See mergekit-config.yml for details on the merge method used.
Warning: This model can produce NSFW content!
Results
- Bigger version of original, uncensored like oryginal.
- Retains all good qualities of original with additional affinity for abstract and lighthearted humor
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 56.07 |
| AI2 Reasoning Challenge (25-Shot) | 61.35 |
| HellaSwag (10-Shot) | 85.26 |
| MMLU (5-Shot) | 57.15 |
| TruthfulQA (0-shot) | 55.29 |
| Winogrande (5-shot) | 75.30 |
| GSM8k (5-shot) | 2.05 |
- Downloads last month
- 2
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard61.350
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard85.260
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard57.150
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard55.290
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard75.300
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard2.050