Model: gabrielmbmb/smollm2-1.7B-8k-mix7-ep2-v2-qlora-r16-a16-lr3e4-mix1-dpo
Author: gabrielmbmb
Library: peft
Tags: peft, tensorboard, safetensors, llama, alignment-handbook, trl, dpo, generated_from_trainer, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:HuggingFaceTB/SmolLM2-1.7B-sft-only, base_model:adapter:HuggingFaceTB/SmolLM2-1.7B-sft-only, 4-bit, bitsandbytes, region:us
Base models (adapter): id: HuggingFaceTB/SmolLM2-1.7B-sft-only
Card metadata: library_name: peft
base_model: HuggingFaceTB/smollm2-1.7B-8k-mix7-ep2-v2
tags: alignment-handbook, trl, dpo, generated_from_trainer
datasets: HuggingFaceH4/ultrafeedback_binarized
model-index: name: smollm2-1.7B-8k-mix7-ep2-v2-qlora-r16-a16-lr3e4-mix1-dpo
Likes: 0 | All-time downloads: 11
Created: 2024-11-05 11:00:21