Model: Team-Promptia/Qwen3-Stratos-32B
Author: Team-Promptia
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, qwen, qwen3, fine-tuned, causal-lm, text-generation, trl, deepspeed, autotrain-compatible, en, dataset:bespokelabs/Bespoke-Stratos-17k, base_model:Qwen/Qwen3-32B, base_model:finetune:Qwen/Qwen3-32B, license:apache-2.0, model-index, endpoints_compatible, region:us
Base models (finetune): id: Qwen/Qwen3-32B
Card metadata: license: apache-2.0
language: en
library_name: transformers
tags: qwen, qwen3, fine-tuned, causal-lm, text-generation, trl, deepspeed, autotrain-compatible
datasets: bespokelabs/Bespoke-Stratos-17k
pipeline_tag: text-generation
base_model: Qwen/Qwen3-32B
model-index: name: Team-Promptia/Qwen3-Stratos-32B
results: task: type: text-generation
name: Text Generation
dataset: type: bespokelabs/Bespoke-Stratos-17k
name: Bespoke-Stratos-17k
metrics: type: N/A
value: N/A
name: Evaluation not performed
description: No evaluation metrics have been calculated for this model yet.
verified: no
model-card: training-data: Fine-tuned on the 'train' split of the [bespokelabs/Bespoke-Stratos-17k](https://huggingface.co/datasets/bespokelabs/Bespoke-Stratos-17k) dataset.
hardware: 4 x NVIDIA H100 80GB
hours-trained: 32.33
cloud-provider-or-cluster-name: Private Cluster
training-regime: name: Base Model
value: Qwen/Qwen3-32B, name: Max Sequence Length
value: 16384, name: Epochs
value: 3, name: Per-Device Batch Size (GPU)
value: 1, name: Gradient Accumulation Steps
value: 24, name: Effective Batch Size
value: 96, name: Optimizer
value: AdamW (via DeepSpeed), name: Learning Rate
value: 1e-5, name: LR Scheduler
value: cosine, name: Warmup Ratio
value: 0.1, name: Precision
value: bf16, name: TF32 Enabled
value: yes, name: Gradient Checkpointing
value: yes, name: Strategy
value: DeepSpeed ZeRO Stage 3, name: Number of Processes
value: 4
framework-versions: name: Transformers
value: 4.51.1, name: Pytorch
value: 2.6.0+cu124, name: Datasets
value: 3.2.0, name: Tokenizers
value: 0.21.4, name: DeepSpeed
value: 0.15.4, name: TRL
value: Used SFTTrainer (version not specified, but compatible with above)
Likes: 0 | All-time downloads: 113
Created: 2025-08-06 01:43:13