failspy
/

Nemotron-4-340B-Instruct-SafeTensors

Text Generation

Inference Endpoints

Model card Files Files and versions Community

failspy commited on Jun 16

Commit

6507917

•

1 Parent(s): a92e6f9

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -11,7 +11,7 @@
   "initializer_range": 0.0063,
   "intermediate_size": 73728,
   "max_position_embeddings": 4096,
-  "model_type": "megatron",
   "num_attention_heads": 96,
   "num_hidden_layers": 96,
   "num_key_value_heads": 8,

   "initializer_range": 0.0063,
   "intermediate_size": 73728,
   "max_position_embeddings": 4096,
+  "model_type": "nemotron",
   "num_attention_heads": 96,
   "num_hidden_layers": 96,
   "num_key_value_heads": 8,