Maya for the browser (int8 ONNX)
Maya, a 150M-parameter yes/no gate, exported for ONNX Runtime Web: one graph, int8 weight-only quantization (MatMulNBits block 128, int8 embeddings), 161 MB.
model.onnx+model.onnx.datasplit into 24 MiB parts (model.onnx.data.partNNN);manifest.jsonlists the parts with the total size and SHA-256. Concatenate the parts in order to getmodel.onnx.data.- Inputs
input_ids,attention_mask(int64, [batch, seq]) fromtokenizer.json, encoding the pair(text, statement); outputlogits[batch, 2]. - P(yes) = sigmoid((logits[:, 0] - logits[:, 1]) / temperature), temperature in
maya_config.json(2.8). - Checked against PyTorch on 256 hand-labeled answers: 81.6% accuracy (PyTorch 81.25%), 1 answer flips, largest probability change 0.12.
Code and evaluation: https://github.com/vishalmysore/maya. Same weak spots as the PyTorch model (agent guardrails, minimal pairs in unseen domains); do not use it as the only safety check.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for VishalMysore/mayaWasm
Base model
answerdotai/ModernBERT-base Finetuned
VishalMysore/maya