@Xenova on Hugging Face: "Introducing Moonshine Web: real-time speech recognition running 100% locally…"

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

posted an update Dec 18, 2024

Post

5295

Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser!
🚀 Faster and more accurate than Whisper
🔒 Privacy-focused (no data leaves your device)
⚡️ WebGPU accelerated (w/ WASM fallback)
🔥 Powered by ONNX Runtime Web and Transformers.js

Demo: webml-community/moonshine-web
Source code: https://github.com/huggingface/transformers.js-examples/tree/main/moonshine-web

adamm-hf

Dec 27, 2024

waiting for moonshine-distilled next :)

vishnusureshperumbavoor

Jan 1, 2025

How much data required to download the model

Xenova

Jan 1, 2025

For this demo, ~150MB if using WebGPU and ~120MB if using WASM.

nmstoker

Jan 2, 2025

@Xenova - Happy New Year! 🎉

With the demo link above I'm seeing issues when running on Linux with Chrome on a laptop which make me wonder if the WASM fallback is working in my case.

I get this message:

An error occurred
Requested device not found

The message about the requested device is quickly replaced with:

Uncaught Error: no available backend found. ERR: [webgpu] Error: Failed to get GPU adapter. You may need to enable flag "--enable-unsafe-webgpu" if you are using Chrome.

I've tried setting the Chrome flags, but that doesn't seem to make any difference.

Is there anything you'd recommend I check to try to diagnose the issue? Or a way to force the WASM fallback?

I'd previously had great results on my main PC (but this has a 3090 GPU) and on mobile (Android Pixel 8 Pro which also has GPU support) and it was only when I went to test on some slightly older devices I came upon this issue.

Problem laptop has Chrome Version 131.0.6778.204 (Official Build) (64-bit), it's running Arch Linux. CPU is an i7-7500U from 2017 which has Intel® HD Graphics 620.

nmstoker

Jan 2, 2025

Quick update: I was able to confirm that I can get some other WebGPU demos working in Chrome on this particular laptop.

Eg managed to get this: https://toji.github.io/webgpu-clustered-shading/ running.

I made sure Vulkan was installed and gives sensible output in the terminal from: sudo vulkaninfo and then I made sure it was enabled in Chrome (the flag options for Vulkan won't appear in Chrome flags without also setting "Temporarily unexpire M130 flags") along with the flag for enable-unsafe-webgpu.

Unfortunately no change in the error messages from the Moonshine demo link.

In this post