Hugging Face model: MaziyarPanahi/MixTAO-7Bx2-MoE-v8.1-GGUF
Author: MaziyarPanahi
Created: 2024-03-06 20:37:35
Last modified: 2024-03-11 09:00:47
Pipeline: text-generation
Library: transformers
Likes: 12 | Downloads: 578
Tags: transformers, gguf, mistral, quantized, 2-bit, 3-bit, 4-bit, 5-bit, 6-bit, 8-bit, GGUF, safetensors, mixtral, text-generation, moe, license:apache-2.0, model-index, autotrain_compatible, endpoints_compatible, text-generation-inference, region:us, base_model:mixtao/MixTAO-7Bx2-MoE-v8.1, base_model:quantized:mixtao/MixTAO-7Bx2-MoE-v8.1
Base model relation: quantized
Base models: id: mixtao/MixTAO-7Bx2-MoE-v8.1
Card metadata:
tags: quantized, 2-bit, 3-bit, 4-bit, 5-bit, 6-bit, 8-bit, GGUF, transformers, safetensors, mixtral, text-generation, moe, license:apache-2.0, model-index, autotrain_compatible, endpoints_compatible, text-generation-inference, region:us, text-generation
model_name: MixTAO-7Bx2-MoE-v8.1-GGUF
base_model: zhengr/MixTAO-7Bx2-MoE-v8.1
inference: no
model_creator: zhengr
pipeline_tag: text-generation
quantized_by: MaziyarPanahi