Hugging Face's logo

TeeZee
/
falcon-180B-chat-AWQ

Text Generation
Transformers
Safetensors
4 languages
falcon
conversational
text-generation-inference
4-bit precision
Model card Files Community
Edit model card

Falcon 180B Chat - AWQ

Description

This repo contains AWQ model files for Technology Innovation Institute's Falcon 180B Chat. with correct chat template inside tokenizer_config.json

Contact

falconllm@tii.ae

Downloads last month
1
Safetensors
Model size
25.7B params
Tensor type
I32
·
FP16
·
Inference API
Text Generation
Examples
Input a message to start chatting with TeeZee/falcon-180B-chat-AWQ.
Inference API (serverless) has been turned off for this model.

Quantized from

Dataset used to train TeeZee/falcon-180B-chat-AWQ