Hugging Face's logo

nanotron
/
doremi-llama-2.5b-reference

Model card Files Community
doremi-llama-2.5b-reference / 70000 /optimizer /optimizer_config.json
neuralink's picture
neuralink
add the 70k checkpoint
4a65de7
raw history blame contribute delete
No virus
124 Bytes
{"type": "OptimizerFromGradientAccumulator", "parallelism": {"tp_size": "8", "dp_size": "8", "pp_size": "1"}, "configs": {}}