Tokenizer Causing OOM

#2
by sunjungyum - opened

Hi, I'm working on a project that uses BioVil. I am getting an OOM error on Cuda that I've narrowed down to the pre-trained BioVil tokenizer. When this is imported I get the OOM error whereas when I use another tokenizer I do not. Has anyone run into this issue?

Hey! I wish I had an answer for you; this sounds really frustrating! I've been having an eerily similar problem, will let you know if I figure it out!

This comment has been hidden
Microsoft org

Can you please share a snippet to reproduce this?

Sign up or log in to comment