Aleph-Alpha
/

Pharia-1-Embedding-4608-control-hf

Model card Files Files and versions Community

peralp24 commited on 16 days ago

Commit

22a8cfd

•

1 Parent(s): 3cb071d

Update modeling_pharia.py

Files changed (1) hide show

modeling_pharia.py +2 -1

modeling_pharia.py CHANGED Viewed

@@ -77,7 +77,8 @@ class PhariaConfig(PretrainedConfig):
         initializer_range=0.02,
         intermediate_size=2048,
         max_position_embeddings=8192,
-        model_type="pharia-v2",
         num_attention_heads=4,
         num_hidden_layers=4,
         num_key_value_heads=2,

         initializer_range=0.02,
         intermediate_size=2048,
         max_position_embeddings=8192,
+        #model_type="pharia-v2",
+        model_type="phariaembed",
         num_attention_heads=4,
         num_hidden_layers=4,
         num_key_value_heads=2,