This is a 4-bit BitsAndBytes quantized version of ruGPT-3.5 13B, based on Gaivoronsky/ruGPT-3.5-13B-fp16
- Downloads last month
- 17
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.