Edit model card

Uploaded model

  • Developed by: Ammartatox
  • License: apache-2.0
  • Finetuned from model : NousResearch/Nous-Hermes-2-Mistral-7B-DPO

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
10
Inference API
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Daemontatox/hermdpo

Finetuned
this model
Quantizations
1 model