Hugging Face's logo

Felladrin
/
onnx-Llama-68M-Chat-v1

Text Generation
Transformers.js
ONNX
English
llama
conversational
Model card Files Community
Edit model card

INT8 ONNX version of Felladrin/Llama-68M-Chat-v1 to use with Transformers.js.

Downloads last month
2
Inference API
Text Generation
Examples
Input a message to start chatting with Felladrin/onnx-Llama-68M-Chat-v1.
Inference API (serverless) does not yet support transformers.js models for this pipeline type.

Finetuned from