Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
Sheep-Duck-Llama-2-70B-AWQ
like
0
Text Generation
Transformers
Safetensors
English
llama
Riiid
llama-2
text-generation-inference
4-bit precision
awq
arxiv:
2306.02707
License:
llama2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Sheep-Duck-Llama-2-70B-AWQ
1 contributor
History:
6 commits
TheBloke
Update for Transformers AWQ support
ddc0589
10 months ago
.gitattributes
1.52 kB
initial commit
11 months ago
LICENSE.txt
7.02 kB
AWQ model commit
11 months ago
Notice
112 Bytes
AWQ model commit
11 months ago
README.md
14.3 kB
Update base_model formatting
11 months ago
USE_POLICY.md
4.77 kB
AWQ model commit
11 months ago
config.json
766 Bytes
Update for Transformers AWQ support
10 months ago
generation_config.json
154 Bytes
AWQ model commit
11 months ago
model-00001-of-00004.safetensors
9.94 GB
LFS
AWQ model commit
11 months ago
model-00002-of-00004.safetensors
9.9 GB
LFS
AWQ model commit
11 months ago
model-00003-of-00004.safetensors
9.9 GB
LFS
AWQ model commit
11 months ago
model-00004-of-00004.safetensors
6.87 GB
LFS
AWQ model commit
11 months ago
model.safetensors.index.json
159 kB
AWQ model commit
11 months ago
quant_config.json
90 Bytes
AWQ model commit
11 months ago
special_tokens_map.json
414 Bytes
AWQ model commit
11 months ago
tokenizer.json
1.84 MB
AWQ model commit
11 months ago
tokenizer.model
500 kB
LFS
AWQ model commit
11 months ago
tokenizer_config.json
735 Bytes
AWQ model commit
11 months ago