DPO from the model ranked 6th on the overall leaderboard and 1st in the 7B leaderboard - v1olet/v1olet_marcoroni-go-bruins-merge-7B.

You can use alpaca template.

template_format = """{system}
### Instruction:
{prompt}

### Response:
"""

Developed by: Trong-Hieu Nguyen-Mau

Downloads last month
1,113
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for v1olet/v1olet_merged_dpo_7B

Quantizations
1 model

Spaces using v1olet/v1olet_merged_dpo_7B 16