Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
orca_mini_7B-GPTQ
like
12
Text Generation
Transformers
Safetensors
psmathur/alpaca_orca
psmathur/dolly-v2_orca
psmathur/WizardLM_Orca
English
llama
text-generation-inference
4-bit precision
arxiv:
2306.02707
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
orca_mini_7B-GPTQ
1 contributor
History:
13 commits
TheBloke
Update for Transformers GPTQ support
7413c35
9 months ago
.gitattributes
1.52 kB
initial commit
11 months ago
README.md
15.6 kB
Update for Transformers GPTQ support
9 months ago
config.json
782 Bytes
Update for Transformers GPTQ support
9 months ago
generation_config.json
132 Bytes
Initial GPTQ model commit
11 months ago
model.safetensors
4.52 GB
LFS
Update for Transformers GPTQ support
9 months ago
quantize_config.json
158 Bytes
Update for Transformers GPTQ support
9 months ago
special_tokens_map.json
208 Bytes
Initial GPTQ model commit
11 months ago
tokenizer.json
1.98 MB
Initial GPTQ model commit
11 months ago
tokenizer.model
534 kB
LFS
Initial GPTQ model commit
11 months ago
tokenizer_config.json
700 Bytes
Initial GPTQ model commit
11 months ago