[blip_text_model] num_attention_heads is 8? not 12? [blip_vision_model] eps is 1e-5?
#5
by
junnyu
- opened
(1) i find https://github.com/salesforce/BLIP/blob/main/configs/med_config.json num_attention_heads is 12, but in this repo num_attention_heads is 8
(2) and blip_vision_model eps shoud be 1e-6, not 1e-5
Hi
@junnyu
I think you are right, see related: https://github.com/huggingface/transformers/issues/22625