Awesome, Details on training requested
#6
by
gsaivinay
- opened
This comment has been hidden
gsaivinay
changed discussion status to
closed
Hey hopefully you figured something out :) just saw this
@pszemraj ohh yes.. I have enabled fp16 dtype in torch and didn't notice it, and apparently fp16 training is an issue with t5 models.
your model is excellent though... training notebook example is much appreciated nevertheless.
I was more looking into a closed domain QA type model with all the text data I have and exploring various options and approaches.
Thanks for your reply. 😊