SequentialLearning
/

SuperLinear

mixture-of-experts

Model card Files Files and versions

razmars commited on May 13

Commit

2b8d6db

·

verified ·

1 Parent(s): 0b9df35

Update full_shot/config.json

Files changed (1) hide show

full_shot/config.json +1 -1

full_shot/config.json CHANGED Viewed

@@ -39,6 +39,6 @@
   "lradj": "constant",
   "learning_rate": 0.05,
   "channel_ind": 0,
-  "misc_moe" :10,
   "full_size":0
 }

   "lradj": "constant",
   "learning_rate": 0.05,
   "channel_ind": 0,
+  "misc_moe" :12,
   "full_size":0
 }