Bug on line 212 of modeling_ltgbert.py

by nikitastheo - opened Sep 1

Sep 1

Hi, I think there is a bug on line 213 of the model file, where self.position_bucker_size is called but it should be instead, self.config.position_bucker_size, as the Attention module does not have this attribute.

lgcharpe

Language Technology Group (University of Oslo) org Sep 2

Yes, you are right. I have now fixed the error

nikitastheo

Sep 2

Thanks for the reply and the fix! Maybe you could also fix it at ltg/ltg-bert-babylm? I think there is the same issue. Thanks again.

lgcharpe

Language Technology Group (University of Oslo) org Sep 4

Done

lgcharpe changed discussion status to closed Sep 4

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment