Hugging Face model: coder1969/tinyllama-1.1B-dpo-rlhf
Author: coder1969
Created: 2026-05-02 07:20:46
Last modified: 2026-05-02 07:20:57
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 5
Tags: peft, safetensors, base_model:adapter:TinyLlama/TinyLlama-1.1B-Chat-v1.0, dpo, lora, transformers, trl, text-generation, conversational, arxiv:2305.18290, base_model:TinyLlama/TinyLlama-1.1B-Chat-v1.0, region:us
Base model relation: adapter
Base models: id: TinyLlama/TinyLlama-1.1B-Chat-v1.0
Card metadata:
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
library_name: peft
model_name: dpo_model
tags: base_model:adapter:TinyLlama/TinyLlama-1.1B-Chat-v1.0, dpo, lora, transformers, trl
licence: license
pipeline_tag: text-generation