Model: jcmei/llama-3-8b-instruct-vpo-iter1
Author: jcmei
Tags: safetensors, llama, alignment-handbook, generated_from_trainer, trl, sppo, dataset:synthetic_data_llama-3-8b-instruct-vpo-iter1_score, base_model:meta-llama/Meta-Llama-3-8B-Instruct, base_model:finetune:meta-llama/Meta-Llama-3-8B-Instruct, license:llama3, region:us
Base models (finetune): id: meta-llama/Meta-Llama-3-8B-Instruct
Card metadata: license: llama3
base_model: meta-llama/Meta-Llama-3-8B-Instruct
tags: alignment-handbook, generated_from_trainer, trl, sppo, trl, sppo
datasets: synthetic_data_llama-3-8b-instruct-vpo-iter1_score
model-index: name: mistral-7b-instruct-sppo-iter1
Likes: 0 | All-time downloads: 5
Created: 2024-11-21 20:23:45