Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
KAI-7B-beta-AWQ
like
2
Text Generation
Transformers
Safetensors
English
mistral
code
text-generation-inference
pretrained
4-bit precision
awq
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
KAI-7B-beta-AWQ
1 contributor
History:
8 commits
TheBloke
Update for Transformers AWQ support
8277ebd
12 months ago
.gitattributes
Safe
1.52 kB
initial commit
12 months ago
README.md
Safe
13.8 kB
Upload README.md
12 months ago
config.json
Safe
831 Bytes
AWQ model commit
12 months ago
generation_config.json
Safe
116 Bytes
AWQ model commit
12 months ago
model.safetensors
Safe
4.15 GB
LFS
AWQ model commit
12 months ago
quant_config.json
Safe
90 Bytes
AWQ model commit
12 months ago
special_tokens_map.json
Safe
72 Bytes
AWQ model commit
12 months ago
tokenizer.json
Safe
1.8 MB
AWQ model commit
12 months ago
tokenizer.model
Safe
493 kB
LFS
AWQ model commit
12 months ago
tokenizer_config.json
Safe
966 Bytes
AWQ model commit
12 months ago