Hugging Face model: ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ
Author: ProphetOfBostrom
Created: 2024-01-12 21:58:06
Last modified: 2024-03-05 19:57:38
Pipeline: text-generation
Library: transformers
Likes: 6 | Downloads: 12
Tags: transformers, mixtral, text-generation, HQQ, moe, quantized, 2bit, conversational, license:cc-by-nc-4.0, endpoints_compatible, region:us
Card metadata:
license: cc-by-nc-4.0
library_name: transformers
pipeline_tag: text-generation
tags: HQQ, mixtral, moe, quantized, 2bit