Hugging Face model: Esperanto/mistral-7b-kvc-AWQ-int4-onnx
Author: Esperanto
Created: 2024-10-29 14:42:37
Last modified: 2024-12-18 16:56:21
Likes: 0 | Downloads: 3
Tags: onnx, text-generation-inference, mistral, 4-bit precision, AWQ, base_model:mistralai/Mistral-7B-v0.1, base_model:quantized:mistralai/Mistral-7B-v0.1, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-7B-v0.1
Card metadata:
tags: text-generation-inference, mistral, 4-bit precision, AWQ
base_model: mistralai/Mistral-7B-v0.1