Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
orca_mini_13B-GPTQ
like
45
Text Generation
Transformers
Safetensors
psmathur/alpaca_orca
psmathur/dolly-v2_orca
psmathur/WizardLM_Orca
English
llama
text-generation-inference
4-bit precision
gptq
arxiv:
2306.02707
License:
mit
Model card
Files
Files and versions
Community
5
Train
Deploy
Use this model
main
orca_mini_13B-GPTQ
1 contributor
History:
16 commits
TheBloke
Update for Transformers GPTQ support
8ec18e5
10 months ago
.gitattributes
1.52 kB
initial commit
12 months ago
README.md
15.8 kB
Update for Transformers GPTQ support
10 months ago
config.json
783 Bytes
Update for Transformers GPTQ support
10 months ago
generation_config.json
132 Bytes
Initial GPTQ model commit
12 months ago
model.safetensors
8.11 GB
LFS
Update for Transformers GPTQ support
10 months ago
quantize_config.json
158 Bytes
Update for Transformers GPTQ support
10 months ago
special_tokens_map.json
208 Bytes
Initial GPTQ model commit
12 months ago
tokenizer.json
1.98 MB
Initial GPTQ model commit
12 months ago
tokenizer.model
534 kB
LFS
Initial GPTQ model commit
12 months ago
tokenizer_config.json
700 Bytes
Initial GPTQ model commit
12 months ago