nathanrchn
/

Qwen1.5-0.4B-Chat

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

nathanrchn commited on Apr 5

Commit

fa1e762

•

1 Parent(s): bf1dba4

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -14,7 +14,7 @@
   "max_window_layers": 21,
   "model_type": "qwen2",
   "num_attention_heads": 16,
-  "num_hidden_layers": 24,
   "num_key_value_heads": 16,
   "rms_norm_eps": 1e-06,
   "rope_theta": 1000000.0,

   "max_window_layers": 21,
   "model_type": "qwen2",
   "num_attention_heads": 16,
+  "num_hidden_layers": 20,
   "num_key_value_heads": 16,
   "rms_norm_eps": 1e-06,
   "rope_theta": 1000000.0,