yayaiu6/Verto-Arabic-ASR

Verto Arabic ASR

Egyptian Arabic and mixed Arabic–English speech recognition, packaged as ONNX INT8 for browser use. Audio is processed on your device.

Try the demo · Code and deployment

Model

• Conformer CTC model. Verto provides the INT8 conversion and browser integration; it is not a newly trained model.
• 69.46 MB for the ONNX file; 69.93 MB including tokenizer and audio-processing assets. Sizes are decimal MB; browser runtime files are separate.
• Weight-only INT8 with FP32 activations; some weights remain FP32. Greedy CTC decoding, without KenLM or timestamps.
• The browser application accepts 0.5–60 seconds of audio. CPU/WASM is the default; WebGPU is optional with CPU fallback.

Use in JavaScript

Serve the complete application from the GitHub repository, then import its browser client:

import { VertoASR } from '/assets/app/verto.mjs';

const asr = new VertoASR();
try {
  await asr.load({ device: 'wasm' });
  const result = await asr.transcribe(file); // Browser File object
  console.log(result.text);
} finally {
  asr.close();
}

The app uses ONNX Runtime Web with Verto's audio preprocessing and text decoding. This model is not a drop-in Transformers.js pipeline. Docker deployment needs no Node or npm. Full setup is in the repository README.

For direct ONNX use: mono 16 kHz audio → 80-bin log-Mel features. See preprocessor.json and mel_filters.json. Inputs: features float32 [1, T, 80], feature_lengths int64 [1]. Outputs: log_probs float32 [1, T_out, V], output_lengths int64 [1]. The bundled tokenizer.json is the app's piece table, not Hugging Face Tokenizers format.

Status and source

Preview: browser/native INT8 outputs have been compared on demo clips; human-reference WER/CER evaluation is still pending. Accuracy varies with noise, dialect and unfamiliar words. No claim of unchanged accuracy versus the original model is made.

Source weights: Metro-ASR Space revision 525644dc782b6627f1eb1f0a589407fcacbfc152. The existing MIT license and original attribution are preserved in LICENSE.