YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
payelb/PKUSafeRLHF_Llama-3.2-1B_aligned_with_MARS_RM
Base model: meta-llama/Llama-3.2-1B-Instruct
Alignment dataset: PKU-Alignment/PKU-SafeRLHF
Reward model: payelb/PKUSafeRLHF_roberta-base_1k_fixed_MARS
Method: PPO alignment with LoRA adapters.
Notes:
- Reward normalization and clipping enabled
- KL control enabled
- pad_token_id/eos_token_id explicitly set
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support