Instructions to use thomasjvu/alkahest-2b-q4-onnx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use thomasjvu/alkahest-2b-q4-onnx with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'thomasjvu/alkahest-2b-q4-onnx');
Experimental model. This repository is an experimental Alkahest/Rally package. It may fail, behave unpredictably, or produce unsuitable output. Use at your own risk; do not rely on it for safety-critical or production decisions without your own validation.
thomasjvu/alkahest-2b-q4-onnx
Private q4 WebGPU ONNX package for the finalized Alkahest 2B direct lane.
Text sessions use official-style q4 artifacts:
onnx/embed_tokens_q4.onnxonnx/decoder_model_merged_q4.onnx
This package passed browser text smoke and is kept as the desktop-class direct target.
- Downloads last month
- 13