Hugging Face model: jcmei/llama-3-8b-instruct-vpo-iter2
Author: jcmei
Created: 2024-11-22 13:35:04
Last modified: 2024-11-22 13:41:22
Likes: 0 | Downloads: 4
Tags: safetensors, llama, alignment-handbook, generated_from_trainer, trl, sppo, dataset:synthetic_data_llama-3-8b-instruct-vpo-iter2_score, region:us
Card metadata:
base_model: checkpoints/Llama-3-8B-Instruct-VPO-Iter1
tags: alignment-handbook, generated_from_trainer, trl, sppo
datasets: synthetic_data_llama-3-8b-instruct-vpo-iter2_score