GPU inference support
#5
by
FlirtyFox
- opened
I was unable to get e-5 large to run using BetterTransformers. Does e5-large support GPU acceleration?
I am not familiar with BetterTransformers, but e5-large uses the same architecture as bert-large. If it works for bert-large, then e5-large should work as well.