dropout argument type error

#12
by liangjs - opened

The dropout_rate argument passed to _flash_attention_forward should be a float instead of a Dropout object.
https://huggingface.co/stabilityai/stable-code-3b/blob/0c6e452d83d5db540396651287bfbed4b966af7c/modeling_stablelm.py#L552-L561

Please check this: https://github.com/huggingface/transformers/pull/29236

Sign up or log in to comment