anto18671
/

lumenspark

Text Generation

Model card Files Files and versions Community

lumenspark / config.json

anto18671's picture

Training just started

cff2047 verified about 2 months ago

190 Bytes

	{
	"depth": 6,
	"dropout": 0.1,
	"embed_dim": 512,
	"heads": 4,
	"k": 128,
	"model_type": "linformer",
	"seq_length": 512,
	"transformers_version": "4.45.1",
	"vocab_size": 50257
	}