Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
guanaco-7B-GPTQ
like
27
Text Generation
Transformers
Safetensors
llama
text-generation-inference
4-bit precision
License:
other
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
gptq-8bit-128g-actorder_False
guanaco-7B-GPTQ
1 contributor
History:
13 commits
TheBloke
Upload README.md
6868f60
8 months ago
.gitattributes
1.48 kB
initial commit
12 months ago
README.md
15.1 kB
Upload README.md
8 months ago
config.json
853 Bytes
Update for Transformers GPTQ support
9 months ago
generation_config.json
132 Bytes
Upload new GPTQs with varied parameters
10 months ago
model.safetensors
7.16 GB
LFS
Update for Transformers GPTQ support
9 months ago
quantize_config.json
188 Bytes
Update for Transformers GPTQ support
9 months ago
special_tokens_map.json
411 Bytes
Upload new GPTQs with varied parameters
10 months ago
tokenizer.json
1.84 MB
Upload new GPTQs with varied parameters
10 months ago
tokenizer.model
500 kB
LFS
Upload new GPTQs with varied parameters
10 months ago
tokenizer_config.json
700 Bytes
Upload new GPTQs with varied parameters
10 months ago