dropout argument type error
#12
by
liangjs
- opened
The dropout_rate argument passed to _flash_attention_forward should be a float instead of a Dropout object.
https://huggingface.co/stabilityai/stable-code-3b/blob/0c6e452d83d5db540396651287bfbed4b966af7c/modeling_stablelm.py#L552-L561
Please check this: https://github.com/huggingface/transformers/pull/29236