Hugging Face model: MaziyarPanahi/GritLM-8x7B-GGUF
Author: MaziyarPanahi
Created: 2024-02-22 10:44:39
Last modified: 2024-02-22 12:17:01
Pipeline: text-generation
Library: transformers
Likes: 4 | Downloads: 116
Tags: transformers, gguf, mistral, quantized, 2-bit, 3-bit, 4-bit, 5-bit, 6-bit, 8-bit, GGUF, pytorch, safetensors, mixtral, text-generation, mteb, conversational, custom_code, dataset:GritLM/tulu2, arxiv:2402.09906, license:apache-2.0, model-index, autotrain_compatible, endpoints_compatible, text-generation-inference, region:us, base_model:GritLM/GritLM-8x7B, base_model:quantized:GritLM/GritLM-8x7B
Base model relation: quantized
Base models: id: GritLM/GritLM-8x7B
Card metadata:
tags: quantized, 2-bit, 3-bit, 4-bit, 5-bit, 6-bit, 8-bit, GGUF, transformers, pytorch, safetensors, mixtral, text-generation, mteb, conversational, custom_code, dataset:GritLM/tulu2, arxiv:2402.09906, license:apache-2.0, model-index, autotrain_compatible, endpoints_compatible, text-generation-inference, region:us, text-generation
model_name: GritLM-8x7B-GGUF
base_model: GritLM/GritLM-8x7B
inference: no
model_creator: GritLM
pipeline_tag: text-generation
quantized_by: MaziyarPanahi