i3-lab
/

i3-tiny

Text Generation

i3-architecture

Model card Files Files and versions

i3-tiny / config.json

FlameF0X's picture

Update config.json

4ee20f1 verified 3 months ago

history blame contribute delete

174 Bytes

	{
	"architectures": ["i3"],
	"model_type": "i3",
	"vocab_size": 34,
	"d_model": 256,
	"n_layers": 6,
	"n_heads": 8,
	"rank": 8,
	"d_state": 16,
	"max_seq_len": 128
	}