Hugging Face model: ubitech-edg/qwen2.5-72b-sft
Author: ubitech-edg
Created: 2025-10-31 10:17:32
Last modified: 2025-10-31 20:36:33
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, safetensors, qwen2, text-generation, causal-lm, supervised-fine-tuning, lora, axolotl, deepspeed, qwen, llava, eu-hpc, qa, conversational, en, dataset:synthetic-qa, base_model:Qwen/Qwen2.5-72B, base_model:adapter:Qwen/Qwen2.5-72B, license:apache-2.0, text-generation-inference, endpoints_compatible, 4-bit, bitsandbytes, region:us
Base model relation: adapter
Base models: id: Qwen/Qwen2.5-72B
Card metadata:
language: en
license: apache-2.0
tags: text-generation, causal-lm, supervised-fine-tuning, lora, axolotl, deepspeed, transformers, qwen, llava, eu-hpc, qa
datasets: synthetic-qa
metrics: loss
library_name: transformers
framework: pytorch
base_model: Qwen/Qwen2.5-72B
model_name: qwen2.5-72b-sft
pipeline_tag: text-generation
task_categories: text-generation, question-answering
model_type: AutoModelForCausalLM
inference: parameters: max_new_tokens: 512
temperature: 0.7
top_p: 0.9
trained_on: Leonardo EuroHPC
description: Supervised fine-tuning (SFT) of Qwen2.5-72B using Axolotl and DeepSpeed ZeRO-1. The model was trained with 4-bit NF4 LoRA adapters on deduplicated synthetic QA pairs to enhance question-answering, reasoning, and response generation capabilities. This repository hosts LoRA adapters only, designed to be loaded on top of Qwen/Qwen2.5-72B.