Hugging Face model: sunilrufus/Mistral_Instruct_Nemo_12B_quantized_w8a8
Author: sunilrufus
Created: 2024-09-30 15:52:34
Last modified: 2025-01-02 16:21:49
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 9
Tags: transformers, safetensors, mistral, text-generation, 8bit, Quantization, Mistral, conversational, arxiv:1910.09700, base_model:mistralai/Mistral-Nemo-Instruct-2407, base_model:quantized:mistralai/Mistral-Nemo-Instruct-2407, text-generation-inference, endpoints_compatible, 8-bit, bitsandbytes, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-Nemo-Instruct-2407
Card metadata:
library_name: transformers
tags: 8bit, Quantization, Mistral
base_model: mistralai/Mistral-Nemo-Instruct-2407
pipeline_tag: text-generation