OpenGVLab
/

InternVL-14B-224px

Image Feature Extraction

feature-extraction

Model card Files Files and versions Community

czczup commited on Feb 3

Commit

0bffb65

•

1 Parent(s): d707ab1

Update modeling_internvl.py

Files changed (1) hide show

modeling_internvl.py +1 -1

modeling_internvl.py CHANGED Viewed

@@ -42,7 +42,7 @@ class InternVLPreTrainedModel(PreTrainedModel):
     _keys_to_ignore_on_load_missing = [
         r'position_ids',
     ]
-    _no_split_modules = ['InternAttention', 'LlamaDecoderLayer']
     _skip_keys_device_placement = 'past_key_values'
     _keep_in_fp32_modules = ['wo']

     _keys_to_ignore_on_load_missing = [
         r'position_ids',
     ]
+    _no_split_modules = ['InternAttention', 'LlamaDecoderLayer', 'LlamaForCausalLM']
     _skip_keys_device_placement = 'past_key_values'
     _keep_in_fp32_modules = ['wo']