Hugging Face model: TheBloke/NeuralQuant-9B-GGUF
Author: TheBloke
Created: 2023-12-29 17:06:23
Last modified: 2023-12-30 07:52:17
Library: transformers
Likes: 1 | Downloads: 86
Tags: transformers, gguf, mistral, merge, base_model:mlabonne/NeuralQuant-9B, base_model:quantized:mlabonne/NeuralQuant-9B, license:apache-2.0, region:us
Base model relation: quantized
Base models: id: mlabonne/NeuralQuant-9B
Card metadata:
base_model: mlabonne/NeuralQuant-9B
inference: no
license: apache-2.0
model_creator: Maxime Labonne
model_name: NeuralQuant 9B
model_type: mistral
prompt_template: {prompt}

quantized_by: TheBloke
tags: merge