Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
Carl-Llama-2-13B-AWQ
like
1
Text Generation
Transformers
Safetensors
jerryjalapeno/nart-100k-synthetic
English
llama
text-generation-inference
4-bit precision
awq
License:
cc-by-nc-nd-4.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Carl-Llama-2-13B-AWQ
1 contributor
History:
6 commits
TheBloke
Update for Transformers AWQ support
411ad18
9 months ago
.gitattributes
1.52 kB
initial commit
11 months ago
LICENSE.txt
7.02 kB
AWQ model commit
11 months ago
Notice
112 Bytes
AWQ model commit
11 months ago
README.md
13.5 kB
Update base_model formatting
11 months ago
USE_POLICY.md
4.77 kB
AWQ model commit
11 months ago
config.json
769 Bytes
Update for Transformers AWQ support
9 months ago
generation_config.json
154 Bytes
AWQ model commit
11 months ago
model.safetensors
7.25 GB
LFS
AWQ model commit
11 months ago
quant_config.json
90 Bytes
AWQ model commit
11 months ago
special_tokens_map.json
438 Bytes
AWQ model commit
11 months ago
tokenizer.json
1.84 MB
AWQ model commit
11 months ago
tokenizer.model
500 kB
LFS
AWQ model commit
11 months ago
tokenizer_config.json
828 Bytes
AWQ model commit
11 months ago