Hugging Face's logo

Adun
/
openthaigpt-1.0.0-7b-chat-beta-gptq-4bit

Text Generation
Transformers
llama
Inference Endpoints
Model card Files Community
openthaigpt-1.0.0-7b-chat-beta-gptq-4bit
File size: 468 Bytes 
fb6b312
dedfbbc
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
 
#### This is OpenThaiGPT 1.0.0 beta Chat GPTQ 4 bit Pytorch Model
for GPU RAM 4 GB. ( recommend for GPU RAM 6GB)

convert from FP16 model
#### Adun/openthaigpt-1.0.0-beta-7b-ckpt-hf


![System diagram](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEikhMOUYD0TESbc8MbmBvfJ-9wd98EtPaaOhVw2rHbhn_KSGhTAQ4pQRqbdfzqM_LyI0_KN0tvbUkU9un_JApIjBiXdqdIvsZC0aSok7seDsaYl5PzTfm3ezg1TNiu-WvrbwZK-eR2-SuSjnG0lXCyb3It23KLPcerEkAanP0LJvm8tbWb5apPBiAtu8Ck8/s843/q5-8.png)