Spaces:

randomblock1

/

phi-2

like 20

Runtime error

I'm trying to bring Microsoft's new Phi-2 model to Spaces but it is pretty slow on CPU, even on the upgraded CPU. And that's not even considering the growing queue of other people experimenting with it. I think it'd be a good candidate for a GPU given how popular and performant Phi-2 is (since it's new) and how there isn't an official Colab notebook or quantized version.