Hugging Face model: payelb/aligned_tinyllama_ultrafeedback_fixed1k_mars
Author: payelb
Created: 2026-01-15 16:04:18
Last modified: 2026-01-15 17:46:15
Likes: 0 | Downloads: 0
Tags: safetensors, trl, ppo, lora, alignment, reward-modeling, ultrafeedback, base_model:TinyLlama/TinyLlama-1.1B-Chat-v1.0, base_model:adapter:TinyLlama/TinyLlama-1.1B-Chat-v1.0, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: TinyLlama/TinyLlama-1.1B-Chat-v1.0
Card metadata:
license: apache-2.0
tags: trl, ppo, lora, alignment, reward-modeling, ultrafeedback
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0