Nhanvi282
/

stage3-moe-ft-llavaqwen1.5-0.5b-vista-4ep_llama90b

moe_llava_qwen1_5

Generated from Trainer

Model card Files Files and versions Community

Nhanvi282 commited on Nov 5, 2024

Commit

7e958a2

·

verified ·

1 Parent(s): 59fd7d5

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -1,7 +1,7 @@
 {
   "_name_or_path": "Nhanvi282/stage2-llavaqwen1.5-0.5B-vista-5ep-llama405",
   "architectures": [
-    "MoELLaVAQwen1_5ForCausalLM"
   ],
   "attention_dropout": 0.0,
   "bos_token_id": 151643,

 {
   "_name_or_path": "Nhanvi282/stage2-llavaqwen1.5-0.5B-vista-5ep-llama405",
   "architectures": [
+    "MoELLaVAQwen2ForCausalLM"
   ],
   "attention_dropout": 0.0,
   "bos_token_id": 151643,