Model: jcmei/llama-3-8b-instruct-dpo-iter3
Author: jcmei
Tags: safetensors, llama, alignment-handbook, generated_from_trainer, trl, sppo, dataset:synthetic_data_llama-3-8b-instruct-dpo-iter3_score, region:us
Card metadata: base_model: checkpoints/Llama-3-8B-Instruct-DPO-Iter2
tags: alignment-handbook, generated_from_trainer, trl, sppo
datasets: synthetic_data_llama-3-8b-instruct-dpo-iter3_score
model-index: name: mistral-7b-instruct-sppo-iter1
Likes: 0 | All-time downloads: 9
Created: 2024-11-22 22:59:32