---
license: apache-2.0
datasets:
- argilla/OpenHermes2.5-dpo-binarized-alpha
language:
- en
pipeline_tag: text-generation
tags:
- conversation
- text-generation-inference
- CultriX/NeuralTrix-7B-dpo
- dpo
- merge
---

DPO Finetuned CultriX/NeuralTrix-7B-dpo using argilla/OpenHermes2.5-dpo-binarized-alpha

argilla dpo binarized pairs is a dataset built on top of: https://huggingface.co/datasets/teknium/OpenHermes-2.5 using https://github.com/argilla-io/distilabel if interested.

Thx for the great data sources.