Hugging Face model: alokabhishek/Mistral-7B-Instruct-v0.2-4bit-AWQ
Author: alokabhishek
Created: 2024-03-24 20:30:38
Last modified: 2024-03-24 20:44:47
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 8
Tags: transformers, safetensors, mistral, text-generation, 4bit, AWQ, AutoAWQ, 7b, quantized, Mistral, Mistral-7B, conversational, license:apache-2.0, text-generation-inference, endpoints_compatible, 4-bit, awq, region:us
Card metadata:
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
tags: 4bit, AWQ, AutoAWQ, 7b, quantized, Mistral, Mistral-7B