Hugging Face model: alokabhishek/Mistral-7B-Instruct-v0.2-6.0-bpw-exl2
Author: alokabhishek
Created: 2024-05-09 18:27:42
Last modified: 2024-05-09 19:45:35
Pipeline: text-generation
Library: transformers
Likes: 2 | Downloads: 9
Tags: transformers, pytorch, safetensors, mistral, text-generation, ExLlamaV2, 5bit, Mistral, Mistral-7B, quantized, exl2, 6.0-bpw, conversational, arxiv:2310.06825, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
tags: ExLlamaV2, 5bit, Mistral, Mistral-7B, quantized, exl2, 6.0-bpw