Hugging Face's logo

kingbri
/
airoboros-l2-13b-gpt4-2.0-GPTQ

Text Generation
Transformers
English
llama
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

This is a GPTQ quantized version of airoboros-l2-13b-gpt4-2.0 using float16

Please refer to the original creator for more information.

Branches:

  • main: 4 bits, groupsize 128, act order false
  • 4bit-128g-actorder: 4 bits, groupsize 128, act order true
  • 4bit-32g-actorder: 4 bits, groupsize 32, act order true
Downloads last month
2
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.