Hugging Face's logo

riveRiPH
/
Hathor_Sofit-L3-8B-v1-6.3bpw-h8-exl2

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files

image/png

Hathor_Sofit-L3-8B-v1-6.3bpw-h8-exl2

This is a 6.3bpw(6.3381) h8 exl2 quant of Hathor_Sofit-L3-8B-v1

Built-in(default) calibration dataset is used.

Downloads last month
7
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including riveRiPH/Hathor_Sofit-L3-8B-v1-6.3bpw-h8-exl2