Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Komposter43
/
saiga2_70b_lora-GPTQ
like
2
Text Generation
Transformers
Safetensors
Russian
llama
text-generation-inference
4-bit precision
gptq
License:
llama2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
Saiga2 70B - GPTQ, Russian LLaMA2-based chatbot
Description
Saiga2 70B - GPTQ, Russian LLaMA2-based chatbot
Model creator:
IlyaGusev
Original model:
Saiga2 70B
Description
This repo contains GPTQ model files for
Saiga2 70B
Downloads last month
6
Safetensors
Model size
9.7B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.
Maximize
Quantized from
IlyaGusev/saiga2_70b_lora