Hugging Face's logo

riveRiPH
/
IceCaffeLatteRP-7b-3.17bpw-h8-exl2

Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
alpaca
Not-For-All-Audiences
nsfw
text-generation-inference
Inference Endpoints
Model card Files

IceCaffeLatteRP-7b-3.17bpw-h8-exl2

This is a 3.17bpw(3.1705) h8 exl2 quant of IceCaffeLatteRP-7b

Built-in(default) calibration dataset is used.

Downloads last month
4
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including riveRiPH/IceCaffeLatteRP-7b-3.17bpw-h8-exl2