Instructions to use Geck018/rules-qa-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use Geck018/rules-qa-instruct with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'Geck018/rules-qa-instruct');
rules-qa-instruct
LoRA-specialized then merged Qwen2.5-0.5B-Instruct for grounded rules answers
(@geck018/rules-engine). Trained on multi-domain synthetic Q&A (distractors + abstention).
Usage (Transformers.js)
import { pipeline } from '@huggingface/transformers';
const generator = await pipeline('text-generation', 'geck018/rules-qa-instruct', { dtype: 'q4' });
If a quantized ONNX variant is missing, the library falls back to
onnx-community/Qwen2.5-0.5B-Instruct.
- Downloads last month
- 283