LeroyDyer
/

SpydazWebAI_QuietStar_7b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

LeroyDyer commited on Apr 8

Commit

33be547

•

1 Parent(s): 8af910f

Update configuration_mistral.py

Files changed (1) hide show

configuration_mistral.py +1 -1

configuration_mistral.py CHANGED Viewed

@@ -142,7 +142,7 @@ class MistralConfig(PretrainedConfig):
         use_shallow_talk=False,
         use_complex_think_head=False,
         use_complex_talk_head=True,
-        use_weighted_talk_head=True,
         **kwargs,
     ):
         self.vocab_size = vocab_size

         use_shallow_talk=False,
         use_complex_think_head=False,
         use_complex_talk_head=True,
+        use_weighted_talk_head=False,
         **kwargs,
     ):
         self.vocab_size = vocab_size