Instructions to use thomasjvu/alkahest-2b-text-q4-onnx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use thomasjvu/alkahest-2b-text-q4-onnx with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'thomasjvu/alkahest-2b-text-q4-onnx');
Experimental model. This repository is an experimental Alkahest/Rally package. It may fail, behave unpredictably, or produce unsuitable output. Use at your own risk; do not rely on it for safety-critical or production decisions without your own validation.
thomasjvu/alkahest-2b-text-q4-onnx
q4 WebGPU ONNX package for Alkahest Qwen3.5.
Source checkpoint: thomasjvu/alkahest-2b-source-merged
Included ONNX sessions:
onnx/embed_tokens_q4.onnxonnx/decoder_model_merged_q4.onnx
The vision encoder is intentionally omitted to reduce browser cold-load size.
- Downloads last month
- 1