phatvo
/

Llama-3.1-8B-Instruct-RAFT-GPTQ-4bits

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-RAFT-GPTQ-4bits / README.md

phatvo's picture

Update README.md

e93db9f verified 7 months ago

|

history blame contribute delete

200 Bytes

metadata

library_name: transformers
license: llama3.1

Model Card for Model ID

4bit Quantized of phatvo/Meta-Llama3.1-8B-Instruct-RAFT