Adun
/

openthaigpt-1.0.0-7b-chat-beta-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

openthaigpt-1.0.0-7b-chat-beta-gptq-4bit / README.md

Adun's picture

Update README.md

fb6b312 about 1 year ago

|

No virus

468 Bytes

This is OpenThaiGPT 1.0.0 beta Chat GPTQ 4 bit Pytorch Model

for GPU RAM 4 GB. ( recommend for GPU RAM 6GB)

convert from FP16 model

Adun/openthaigpt-1.0.0-beta-7b-ckpt-hf