MrGonao
/

delphi-mamba-3.2M

Inference Endpoints

Model card Files Files and versions Community

delphi-mamba-3.2M / config.json

MrGonao's picture

Upload

815783e 4 months ago

raw history blame contribute delete

No virus

198 Bytes

	{
	"d_model": 280,
	"n_layer": 6,
	"vocab_size": 4096,
	"ssm_cfg": {},
	"rms_norm": true,
	"residual_in_fp32": true,
	"fused_add_norm": true,
	"pad_vocab_size_multiple": 8
	}