davanstrien
/

HaikuHermes-0.1-7B

Text Generation

text-generation-inference

Model card Files Files and versions

Model Card for HaikuHermes-0.1-7B

This is a very early model which uses the davanstrien/haiku_dpo dataset to train teknium/OpenHermes-2.5-Mistral-7B using Direct Preference Optimization.

The eventual goal of this model is for it to write "technically correct" haiku.

Downloads last month: 11

Safetensors

Model size

7.24B params

Tensor type

F16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for davanstrien/HaikuHermes-0.1-7B

Base model

mistralai/Mistral-7B-v0.1

Finetuned

teknium/OpenHermes-2.5-Mistral-7B

Finetuned

(78)

this model

Dataset used to train davanstrien/HaikuHermes-0.1-7B

Collection including davanstrien/HaikuHermes-0.1-7B

haiku

🌸 This is a collection of synthetic datasets built to help improve the ability of open language models to better write haikus through the use of DPO • 3 items • Updated Jun 21, 2024 • 6