DewEfresh
/

Neo_7b-merge8

Text Generation

DewEfresh/neo_7b

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

DewEfresh commited on Jun 30

Commit

929c2da

•

1 Parent(s): a07e925

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -15,7 +15,7 @@
   "mlp_bias": false,
   "model_type": "llama",
   "num_attention_heads": 16,
-  "num_hidden_layers": 0,
   "num_key_value_heads": 16,
   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,

   "mlp_bias": false,
   "model_type": "llama",
   "num_attention_heads": 16,
+  "num_hidden_layers": 21,
   "num_key_value_heads": 16,
   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,