Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
Llama-2-7B-GPTQ
like
79
Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-2
text-generation-inference
4-bit precision
arxiv:
2307.09288
License:
llama2
Model card
Files
Files and versions
Community
12
Train
Deploy
Use in Transformers
gptq-4bit-128g-actorder_True
Llama-2-7B-GPTQ
1 contributor
History:
32 commits
TheBloke
Upload README.md
b76c9c6
8 months ago
.gitattributes
1.52 kB
initial commit
10 months ago
LICENSE
50.3 kB
Initial GPTQ model commit
10 months ago
Notice
112 Bytes
Initial GPTQ model commit
10 months ago
README.md
23.1 kB
Upload README.md
8 months ago
config.json
761 Bytes
Update for Transformers GPTQ support
9 months ago
generation_config.json
132 Bytes
Initial GPTQ model commit
10 months ago
model.safetensors
3.9 GB
LFS
Update for Transformers GPTQ support
9 months ago
quantize_config.json
187 Bytes
Update for Transformers GPTQ support
9 months ago
special_tokens_map.json
411 Bytes
Initial GPTQ model commit
10 months ago
tokenizer.json
1.84 MB
Initial GPTQ model commit
10 months ago
tokenizer.model
500 kB
LFS
Initial GPTQ model commit
10 months ago
tokenizer_config.json
727 Bytes
Initial GPTQ model commit
10 months ago