Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
Experimental quant used for testing slightly different shrinking methods. Use the other one down below for now.
https://huggingface.co/ParasiticRogue/RP-Stew-v2.5-34B-exl2-4.65
- Downloads last month
- 2
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.