Hugging Face model: ubitech-edg/mistral-12b-sft
Author: ubitech-edg
Created: 2025-10-19 07:28:59
Last modified: 2025-10-19 07:32:04
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 8
Tags: transformers, safetensors, mistral, text-generation, causal-lm, instruction-tuning, supervised-fine-tuning, synthetic-qa, lora, axolotl, deepspeed, nemo, eu-hpc, conversational, en, dataset:axolotl_deduplicated_synthetic_qa, base_model:mistralai/Mistral-Nemo-Instruct-2407, base_model:adapter:mistralai/Mistral-Nemo-Instruct-2407, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: adapter
Base models: id: mistralai/Mistral-Nemo-Instruct-2407
Card metadata:
language: en
license: apache-2.0
tags: text-generation, causal-lm, instruction-tuning, supervised-fine-tuning, synthetic-qa, lora, axolotl, deepspeed, transformers, mistral, nemo, eu-hpc
datasets: axolotl_deduplicated_synthetic_qa
metrics: loss
library_name: transformers
framework: pytorch
base_model: mistralai/Mistral-Nemo-Instruct-2407
model_name: mistral-12b-sft
pipeline_tag: text-generation
task_categories: text-generation, instruction-following
model_type: AutoModelForCausalLM
inference: parameters: max_new_tokens: 512
temperature: 0.7
top_p: 0.9
trained_on: Leonardo EuroHPC
description: Supervised fine-tuning (SFT) of Mistral 12B Nemo Instruct on synthetic QA data using LoRA with Axolotl and DeepSpeed. Improves conversational reasoning and factual accuracy.