mfarre HF staff Xenova HF staff commited on
Commit
edf555f
·
verified ·
1 Parent(s): eb8cd98

Add missing config value (num_hidden_layers) (#4)

Browse files

- Add missing config value (num_hidden_layers) (11ca7ef66fc6450f9c97a753834aebad1e0274d6)


Co-authored-by: Joshua <Xenova@users.noreply.huggingface.co>

Files changed (1) hide show
  1. config.json +1 -0
config.json CHANGED
@@ -20,6 +20,7 @@
20
  "model_type": "llama",
21
  "neftune_noise_alpha": 0.0,
22
  "num_attention_heads": 15,
 
23
  "num_key_value_heads": 5,
24
  "pad_token_id": 2,
25
  "perceiver_config": {
 
20
  "model_type": "llama",
21
  "neftune_noise_alpha": 0.0,
22
  "num_attention_heads": 15,
23
+ "num_hidden_layers": 32,
24
  "num_key_value_heads": 5,
25
  "pad_token_id": 2,
26
  "perceiver_config": {