Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
guanaco-13B-GPTQ
like
28
Text Generation
Transformers
Safetensors
llama
text-generation-inference
4-bit precision
arxiv:
2305.14314
arxiv:
2302.13971
arxiv:
2304.07327
License:
other
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
main
guanaco-13B-GPTQ
1 contributor
History:
18 commits
TheBloke
Update for Transformers GPTQ support
0c3d775
9 months ago
.gitattributes
1.48 kB
initial commit
12 months ago
README.md
15.6 kB
Update for Transformers GPTQ support
9 months ago
config.json
822 Bytes
Update for Transformers GPTQ support
9 months ago
generation_config.json
132 Bytes
Initial GPTQ model commit
12 months ago
model.safetensors
7.45 GB
LFS
Update for Transformers GPTQ support
9 months ago
quantize_config.json
158 Bytes
Update for Transformers GPTQ support
9 months ago
special_tokens_map.json
411 Bytes
Initial GPTQ model commit
12 months ago
tokenizer.json
1.84 MB
Initial GPTQ model commit
12 months ago
tokenizer.model
500 kB
LFS
Initial GPTQ model commit
12 months ago
tokenizer_config.json
700 Bytes
Initial GPTQ model commit
12 months ago