Hugging Face model: Parveshiiii/mistral-small-int8
Author: Parveshiiii
Created: 2025-07-08 15:01:47
Last modified: 2025-07-08 15:11:04
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 5
Tags: transformers, safetensors, mistral, text-generation, int8, quantized, causal-lm, research-only, base_model:mistralai/Mistral-7B-Instruct-v0.1, base_model:quantized:mistralai/Mistral-7B-Instruct-v0.1, license:mit, text-generation-inference, endpoints_compatible, 8-bit, bitsandbytes, region:us
Base model relation: quantized
Base models: id: mistralai/Mistral-7B-Instruct-v0.1
Card metadata:
license: mit
base_model: mistralai/Mistral-7B-Instruct-v0.1
pipeline_tag: text-generation
tags: int8, quantized, transformers, mistral, causal-lm, research-only
model_name: Mistral-small-INT8
quantization: INT8 via bitsandbytes
total_parameters: 7 Billion
intended_use: Research, benchmarking, single-GPU inference
limitations: May produce unfiltered outputs; add safety layers if deployed