[MODELS] Phi-3 is a miracle

#420
by Mindires - opened

It's hard to imagine that this is a small 3.8B model. It will change snippets, search, and mobile assistants. I am deploying its on my own Ollama. Of course, the cross-language capabilities demonstrated by the current 4k online demo have already made me excited.

Perhaps a recursive summary can be added to allow huggingchat to have unlimited content window (not possible)

There is also bad news. Phi3 is now basically unable to use Internet search, the 4k context directly overflows. Recommended switch to 128k version @nsarrazin

Hugging Chat org

Yeah we're thinking about the longer context version, but I'll see if there's something I can do for making the websearch work on shorter contexts.

Sign up or log in to comment