Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
Carl-33B-GPTQ
like
3
Text Generation
Transformers
Safetensors
jerryjalapeno/nart-100k-synthetic
English
llama
text-generation-inference
4-bit precision
gptq
License:
other
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
gptq-3bit--1g-actorder_True
Carl-33B-GPTQ
1 contributor
History:
11 commits
TheBloke
Update for Transformers GPTQ support
f4b2448
9 months ago
.gitattributes
1.52 kB
initial commit
10 months ago
README.md
14.9 kB
Update for Transformers GPTQ support
9 months ago
config.json
896 Bytes
Update for Transformers GPTQ support
9 months ago
generation_config.json
137 Bytes
Initial GPTQ model commit
10 months ago
model.safetensors
12.9 GB
LFS
Update for Transformers GPTQ support
9 months ago
quantize_config.json
185 Bytes
Update for Transformers GPTQ support
9 months ago
special_tokens_map.json
435 Bytes
Initial GPTQ model commit
10 months ago
tokenizer.json
1.84 MB
Initial GPTQ model commit
10 months ago
tokenizer.model
500 kB
LFS
Initial GPTQ model commit
10 months ago
tokenizer_config.json
745 Bytes
Initial GPTQ model commit
10 months ago