kuotient
/

mamba-ko-2.8b

Text Generation

Inference Endpoints

Model card Files Files and versions Community

mamba-ko-2.8b / config.json

kuotient's picture

Update config.json

4188740 verified 3 months ago

raw history blame contribute delete

No virus

225 Bytes

	{
	"architectures": ["MambaForCausalLM"],
	"d_model": 2560,
	"n_layer": 64,
	"vocab_size": 50277,
	"ssm_cfg": {},
	"rms_norm": true,
	"residual_in_fp32": true,
	"fused_add_norm": true,
	"pad_vocab_size_multiple": 8
	}