Hugging Face's logo

LanguageBind
/
MoE-LLaVA-Phi2-2.7B-4e

Text Generation
Transformers
Safetensors
moe_llava_phi
custom_code
Inference Endpoints
Model card Files Community
2
LanguageBind commited on
Commit
114cedb
•
1 Parent(s): d4ce56d

Upload 11 files

Browse files
Files changed (4) hide show
  1. config.json +1 -1
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
config.json CHANGED
@@ -30,7 +30,7 @@
30
  "mm_vision_select_layer": -2,
31
  "model_type": "moe_llava_phi",
32
  "moe": {
33
- "capacity_factor": 1.0,
34
  "ep_size": 1,
35
  "eval_capacity_factor": 2.0,
36
  "min_capacity": 0,
 
30
  "mm_vision_select_layer": -2,
31
  "model_type": "moe_llava_phi",
32
  "moe": {
33
+ "capacity_factor": 1.5,
34
  "ep_size": 1,
35
  "eval_capacity_factor": 2.0,
36
  "min_capacity": 0,
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e0b0356ccced06e9b9aff992b4f468af4cb9408caa30b7d662d954493c9920af
3
  size 4982356792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84147152902c39bc378a8230ac09a7765f858f4df20db9aba3ab0609c2d48c98
3
  size 4982356792
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2555f01b7f06bcb05ee8b0a9957de91d016f20334f8f028546ae3383491371f6
3
  size 4982435992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a951f20321d6d6ad31a5022a139dae417ed53b5fea7e2aebbfe6887fe3ab8579
3
  size 4982435992
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:83756225090470b7d2b234ac27ddc1a135d822245d21839d5942dbd4f8ee47c6
3
  size 1254712416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd82d3400a693797b666e23c7a27c9c21a426bc64169fc3d979a68427c245828
3
  size 1254712416