Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Xenova 
posted an update 11 days ago
Post
3797
Introducing Phi-3 WebGPU, a private and powerful AI chatbot that runs 100% locally in your browser, powered by 🤗 Transformers.js and onnxruntime-web!

🔒 On-device inference: no data sent to a server
⚡️ WebGPU-accelerated (> 20 t/s)
📥 Model downloaded once and cached

Try it out: Xenova/experimental-phi3-webgpu

Amazing!! Shall we make a VB node for this?

·

The model might be a bit large, but it could be something to try!

This is so cool!

how do u obtain the wasm file? Didn't find it here: https://cdn.jsdelivr.net/npm/@xenova/transformers@2.17.1/dist/

cc: @Xenova