Model: Parveshiiii/mistral-small-int8
Author: Parveshiiii
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, mistral, text-generation, int8, quantized, causal-lm, research-only, base_model:mistralai/Mistral-7B-Instruct-v0.1, base_model:quantized:mistralai/Mistral-7B-Instruct-v0.1, license:mit, text-generation-inference, endpoints_compatible, 8-bit, bitsandbytes, region:us
Base models (quantized): id: mistralai/Mistral-7B-Instruct-v0.1
Card metadata: license: mit
base_model: mistralai/Mistral-7B-Instruct-v0.1
pipeline_tag: text-generation
tags: int8, quantized, transformers, mistral, causal-lm, research-only
model_name: Mistral-small-INT8
quantization: INT8 via bitsandbytes
total_parameters: 7 Billion
intended_use: Research, benchmarking, single-GPU inference
limitations: May produce unfiltered outputs; add safety layers if deployed
Likes: 1 | All-time downloads: 57
Created: 2025-07-08 15:01:47