Hugging Face model: living-box/gemma-2-2b-it-alpaca-cleaned-SFT-PKU-SafeRLHF-OnlineIPO1-lora-0124140623-epoch-4
Author: living-box
Created: 2026-01-24 18:25:06
Last modified: 2026-01-24 18:25:48
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, safetensors, generated_from_trainer, text-generation, fine-tuned, trl, extra-gradient, conversational, dataset:PKU-Alignment/PKU-SafeRLHF, arxiv:2503.08942, base_model:vectorzhou/gemma-2-2b-it-alpaca-cleaned-SFT, base_model:finetune:vectorzhou/gemma-2-2b-it-alpaca-cleaned-SFT, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: vectorzhou/gemma-2-2b-it-alpaca-cleaned-SFT
Card metadata:
base_model: vectorzhou/gemma-2-2b-it-alpaca-cleaned-SFT
datasets: PKU-Alignment/PKU-SafeRLHF
library_name: transformers
model_name: gemma-2-2b-it-alpaca-cleaned-SFT-PKU-SafeRLHF-OnlineIPO1-lora
tags: generated_from_trainer, text-generation, fine-tuned, trl, extra-gradient
licence: license