python-fromzero-lstmlm / config.json
miguelvictor's picture
added model checkpoint
31f745f
{
"architectures": ["LstmLM"],
"bos_token_id": 2,
"eos_token_id": 3,
"model_type": "lstmlm",
"n_embd": 1280,
"n_layer": 8,
"n_positions": 512,
"tokenizer": "default",
"transformers_version": "4.5.1",
"vocab_size": 16000
}