Hugging Face model: Esperanto/phi3-mini-4k-instruct-kvc-AWQ-int4-onnx
Author: Esperanto
Created: 2024-08-07 09:34:13
Last modified: 2024-12-12 09:48:19
Likes: 0 | Downloads: 4
Tags: onnx, text-generation-inference, phi3, 4-bit precision, AWQ, base_model:microsoft/Phi-3-mini-4k-instruct, base_model:quantized:microsoft/Phi-3-mini-4k-instruct, region:us
Base model relation: quantized
Base models: id: microsoft/Phi-3-mini-4k-instruct
Card metadata:
tags: text-generation-inference, phi3, 4-bit precision, AWQ
base_model: microsoft/Phi-3-mini-4k-instruct