Hugging Face model: SURESHBEEKHANI/llama_3_2_3B-dpo-rlhf-fine-tuning
Author: SURESHBEEKHANI
Created: 2025-01-24 08:21:38
Last modified: 2025-01-25 13:31:08
Pipeline: question-answering
Likes: 1 | Downloads: 20
Tags: gguf, llama, question-answering, en, dataset:Intel/orca_dpo_pairs, base_model:unsloth/Llama-3.2-3B-Instruct, base_model:quantized:unsloth/Llama-3.2-3B-Instruct, license:mit, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: unsloth/Llama-3.2-3B-Instruct
Card metadata:
license: mit
datasets: Intel/orca_dpo_pairs
language: en
base_model: unsloth/Llama-3.2-3B-Instruct
pipeline_tag: question-answering