Multi-Domain-Expert-Learning
/

OA_falcon_33b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Ontocord.AI commited on Jul 1, 2023

Commit

a193ead

•

1 Parent(s): dc8d3dd

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -25,7 +25,7 @@
   "model_type": "RefinedWeb",
   "n_head": 128,
   "n_head_kv": 8,
-  "n_layer": 60,
   "parallel_attn": true,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.1",

   "model_type": "RefinedWeb",
   "n_head": 128,
   "n_head_kv": 8,
+  "n_layer": 48,
   "parallel_attn": true,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.1",