Hugging Face model: solidrust/Mini-Mixtral-v0.2-2x7B-AWQ
Author: solidrust
Created: 2024-04-17 09:46:54
Last modified: 2024-09-03 08:42:42
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 8
Tags: transformers, safetensors, mixtral, text-generation, moe, frankenmoe, merge, mergekit, lazymergekit, unsloth/mistral-7b-v0.2, mistralai/Mistral-7B-Instruct-v0.2, quantized, 4-bit, AWQ, autotrain_compatible, endpoints_compatible, chatml, base_model:NeuralNovel/Mini-Mixtral-v0.2, base_model:quantized:NeuralNovel/Mini-Mixtral-v0.2, license:apache-2.0, text-generation-inference, awq, region:us
Base model relation: quantized
Base models: id: NeuralNovel/Mini-Mixtral-v0.2
Card metadata:
base_model: NeuralNovel/Mini-Mixtral-v0.2
inference: no
license: apache-2.0
merged_models: unsloth/mistral-7b-v0.2, mistralai/Mistral-7B-Instruct-v0.2
pipeline_tag: text-generation
quantized_by: Suparious
tags: moe, frankenmoe, merge, mergekit, lazymergekit, unsloth/mistral-7b-v0.2, mistralai/Mistral-7B-Instruct-v0.2, quantized, 4-bit, AWQ, text-generation, autotrain_compatible, endpoints_compatible, chatml