bagel-dpo-2.8b-v0.2 / config.json
jondurbin's picture
Upload folder using huggingface_hub
ef7ed81
raw
history blame contribute delete
200 Bytes
{
"d_model": 2560,
"n_layer": 64,
"vocab_size": 50277,
"ssm_cfg": {},
"rms_norm": true,
"residual_in_fp32": true,
"fused_add_norm": true,
"pad_vocab_size_multiple": 8
}