Tokenizer Causing OOM
#2
by
sunjungyum
- opened
Hi, I'm working on a project that uses BioVil. I am getting an OOM error on Cuda that I've narrowed down to the pre-trained BioVil tokenizer. When this is imported I get the OOM error whereas when I use another tokenizer I do not. Has anyone run into this issue?
Hey! I wish I had an answer for you; this sounds really frustrating! I've been having an eerily similar problem, will let you know if I figure it out!
This comment has been hidden
Can you please share a snippet to reproduce this?