morenolq
/

m2l_2022_nlp

Model card Files Files and versions Community

m2l_2022_nlp / models /europarl /config.json

morenolq

Add models config, data folder (#1)

1542971 almost 2 years ago

raw history blame contribute delete

No virus

236 Bytes

	{
	"batch_size": 64,
	"mask_probability": 0.15,
	"num_layers": 6,
	"num_heads": 8,
	"d_model": 512,
	"d_ff": 1024,
	"p_dropout": 0.1,
	"max_seq_len": 256,
	"vocab_size": 20000,
	"learning_rate": 1e-4,
	"grad_clip_value": 1
	}