short-jokes / hparams.json
enkaell's picture
Upload 8 files
c85eab7
{
"n_vocab": 50257,
"n_ctx": 1024,
"n_embd": 1024,
"n_head": 16,
"n_layer": 24
}