Hugging Face model: zizi917/tinyllama-dpo-pairrm
Author: zizi917
Created: 2025-04-07 00:23:57
Last modified: 2025-04-07 00:24:03
Library: peft
Likes: 0 | Downloads: 6
Tags: peft, safetensors, arxiv:1910.09700, base_model:TinyLlama/TinyLlama-1.1B-Chat-v1.0, base_model:adapter:TinyLlama/TinyLlama-1.1B-Chat-v1.0, region:us
Base model relation: adapter
Base models: id: TinyLlama/TinyLlama-1.1B-Chat-v1.0
Card metadata:
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
library_name: peft