TeeZee
/

falcon-180B-chat-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

Falcon 180B Chat - GPTQ

Model creator: Technology Innovation Institute
Original model: Falcon 180B Chat

Description

This repo contains GPTQ model files for Technology Innovation Institute's Falcon 180B Chat. with correct chat template inside tokenizer_config.json

Contact

falconllm@tii.ae

Downloads last month: 88,471

Safetensors

Model size

24.7B params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for TeeZee/falcon-180B-chat-GPTQ

Base model

tiiuae/falcon-180B-chat

Quantized

(4)

this model

Dataset used to train TeeZee/falcon-180B-chat-GPTQ