metadata
license: apache-2.0
language:
- en
[December 2023] We are ranked 4th on the overall leaderboard and 1st in the 7B leaderboard! 🔥🔥🔥🔥
DPO from the model ranked 6th on the overall leaderboard and 1st in the 7B leaderboard (12th December 2023) - v1olet/v1olet_marcoroni-go-bruins-merge-7B https://huggingface.co/v1olet/v1olet_marcoroni-go-bruins-merge-7B
Training data: comparison_gpt4_en,en_orca_dpo
Train for 1 epoch.
You can use alpaca template.
template_format = """{system}
### Instruction:
{prompt}
### Response:
"""
Developed by: Trong-Hieu Nguyen-Mau