Update README.md
Browse files
README.md
CHANGED
|
@@ -28,6 +28,8 @@ datasets:
|
|
| 28 |
|
| 29 |
### This is the model repo for all GGUF versions of Nous-Hermes 2 7B DPO
|
| 30 |
|
|
|
|
|
|
|
| 31 |
Nous Hermes 2 on Mistral 7B DPO is the new flagship 7B Hermes! This model was DPO'd from [Teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) and has improved across the board on all benchmarks tested - AGIEval, BigBench Reasoning, GPT4All, and TruthfulQA.
|
| 32 |
|
| 33 |
The model prior to DPO was trained on 1,000,000 instructions/chats of GPT-4 quality or better, primarily synthetic data as well as other high quality datasets, available from the repository [teknium/OpenHermes-2.5](https://huggingface.co/datasets/teknium/OpenHermes-2.5).
|
|
|
|
| 28 |
|
| 29 |
### This is the model repo for all GGUF versions of Nous-Hermes 2 7B DPO
|
| 30 |
|
| 31 |
+
The full HF fp16 model can be downloaded here: https://huggingface.co/NousResearch/Nous-Hermes-2-Mistral-7B-DPO
|
| 32 |
+
|
| 33 |
Nous Hermes 2 on Mistral 7B DPO is the new flagship 7B Hermes! This model was DPO'd from [Teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) and has improved across the board on all benchmarks tested - AGIEval, BigBench Reasoning, GPT4All, and TruthfulQA.
|
| 34 |
|
| 35 |
The model prior to DPO was trained on 1,000,000 instructions/chats of GPT-4 quality or better, primarily synthetic data as well as other high quality datasets, available from the repository [teknium/OpenHermes-2.5](https://huggingface.co/datasets/teknium/OpenHermes-2.5).
|