YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
ckpt-countdown-qwen3
Evolution-Strategies fine-tuning checkpoints from IBM Blue Vela.
iter<N>.pth are the periodic training checkpoints and final/pytorch_model.pth
is the end-of-run save. The two are NOT copies of each other even at the same N --
the final save is written a few ES steps after the last periodic one, measured at a
relative L2 difference of 0.002 to 0.004 where ten iterations move 0.008. Treat
final/ as the canonical end-of-run weights.
One copy per iteration is published. Where a run has both a final save and a periodic checkpoint at that same iteration, only the final save is here. Periodic checkpoints at earlier iterations are kept, and a run that never reached its end keeps every periodic checkpoint it has.
Runs still training are not here yet. They are published once they reach their target and write a final save, so that no iteration ever appears twice.
All .pth are bf16 state dicts keyed by vLLM parameter names (fused qkv_proj,
gate_up_proj), loadable by the trainer resume path.
| run | base model | final iteration | periodic checkpoints |
|---|---|---|---|
cd8b-fixed |
Qwen/Qwen3-8B |
500 | none |
cd8b-fresh |
Qwen/Qwen3-8B |
500 | none |
cd8b-hetero |
Qwen/Qwen3-8B |
500 | none |
cd8b-mirror |
Qwen/Qwen3-8B |
500 | none |
cd8b-mirror-v3 |
Qwen/Qwen3-8B |
500 | none |
cdq3-1.7b-fixed |
Qwen/Qwen3-1.7B |
500 | none |
cdq3-1.7b-fresh |
Qwen/Qwen3-1.7B |
500 | none |
cdq3-1.7b-hetero |
Qwen/Qwen3-1.7B |
500 | none |
cdq3-1.7b-mirror |
Qwen/Qwen3-1.7B |
500 | none |
cdq3-1.7b-mirror-v3 |
Qwen/Qwen3-1.7B |
500 | none |
cdq3-4b-fixed |
Qwen/Qwen3-4B |
500 | none |
cdq3-4b-fresh |
Qwen/Qwen3-4B |
500 | none |
cdq3-4b-hetero |
Qwen/Qwen3-4B |
500 | none |
cdq3-4b-hetero-m100 |
Qwen/Qwen3-4B |
300 | none |
cdq3-4b-hetero-m25 |
Qwen/Qwen3-4B |
300 | none |
cdq3-4b-hetero-m400 |
Qwen/Qwen3-4B |
300 | none |
cdq3-4b-hetero-m50 |
Qwen/Qwen3-4B |
300 | none |
cdq3-4b-hetero-n120 |
Qwen/Qwen3-4B |
300 | none |
cdq3-4b-hetero-n15 |
Qwen/Qwen3-4B |
300 | none |
cdq3-4b-hetero-n60 |
Qwen/Qwen3-4B |
300 | none |
cdq3-4b-mirror |
Qwen/Qwen3-4B |
500 | none |
cdq3-4b-mirror-v3 |
Qwen/Qwen3-4B |
500 | none |