Hugging Face model: Esperanto/mistral-7b-Instruct-v0.2-kvc-AWQ-int4-onnx
Author: Esperanto
Created: 2024-08-07 09:18:46
Last modified: 2024-12-12 09:12:14
Likes: 1 | Downloads: 4
Tags: onnx, text-generation-inference, mistral, 4-bit precision, AWQ, base_model:mistralai/Mistral-7B-Instruct-v0.2, base_model:quantized:mistralai/Mistral-7B-Instruct-v0.2, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-7B-Instruct-v0.2
Card metadata:
tags: text-generation-inference, mistral, 4-bit precision, AWQ
base_model: mistralai/Mistral-7B-Instruct-v0.2