CodeLlama-7b / params.json
camenduru's picture
thanks to facebookresearch/codellama ❤
eb27c92
{
"dim": 4096,
"n_layers": 32,
"n_heads": 32,
"multiple_of": 256,
"ffn_dim_multiplier": 1.0,
"norm_eps": 1e-5,
"rope_theta": 1000000
}