bigcode
/

starcoder2-3b

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

muhtasham commited on Mar 2

Commit

8c5d79c

•

1 Parent(s): cc9b0d4

Update config.json

Adding tie_word_embeddings to not return LM head

Files changed (1) hide show

config.json +1 -0

config.json CHANGED Viewed

@@ -19,6 +19,7 @@
   "num_key_value_heads": 2,
   "rope_theta": 999999.4420358813,
   "sliding_window": 4096,
   "transformers_version": "4.37.0.dev0",
   "use_bias": true,
   "use_cache": true,

   "num_key_value_heads": 2,
   "rope_theta": 999999.4420358813,
   "sliding_window": 4096,
+  "tie_word_embeddings": true,
   "transformers_version": "4.37.0.dev0",
   "use_bias": true,
   "use_cache": true,