Qwen3-8B TMax AENV v39b — iteration 89

Reinforcement-learning checkpoint from the tmax_aenv_v39b run, taken at training iteration 89.

The policy was initialized from willamazon1/qwen3-8b-tmax-sft-v3-iter353 (itself an SFT of Qwen/Qwen3-8B) and trained with group-relative policy optimization on asynchronous multi-turn agentic-environment rollouts.

Checkpoints are saved every 10 iterations; iterations 69–219 of this run are published as separate repos in the same collection, so you can compare points along the training curve.

Base model willamazon1/qwen3-8b-tmax-sft-v3-iter353
Stage RL (agentic environment, async rollouts)
Iteration 89
Architecture Qwen3, 36 layers, hidden 4096, 32 heads / 8 KV, vocab 151936
Precision bfloat16

Usage

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "willamazon1/qwen3-8b-tmax-aenv-v39b-iter089"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, dtype=torch.bfloat16, device_map="auto")

msgs = [{"role": "user", "content": "What is 12*8?"}]
text = tok.apply_chat_template(msgs, tokenize=False, add_generation_prompt=True)
ids = tok(text, return_tensors="pt").input_ids.to(model.device)
out = model.generate(ids, max_new_tokens=256)
print(tok.decode(out[0][ids.shape[1]:], skip_special_tokens=True))

Conversion

Converted from a Megatron-LM torch_dist training checkpoint to HuggingFace safetensors with slime's tools/convert_torch_dist_to_hf.py. Embedding padding was stripped back to the tokenizer's vocab_size of 151936, so the tensor shapes match upstream Qwen/Qwen3-8B exactly. Weights are bfloat16; the optimizer state of the training checkpoint is not included.

Every shard was checked for NaN/Inf (none found) and the model was loaded and sampled from before upload.

Downloads last month
174
Safetensors
Model size
8B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for willamazon1/qwen3-8b-tmax-aenv-v39b-iter089

Finetuned
Qwen/Qwen3-8B
Finetuned
(16)
this model

Collection including willamazon1/qwen3-8b-tmax-aenv-v39b-iter089