mahihossain666
/

llama-2-70b-hf-quantized-3bits-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

llama-2-70b-hf-quantized-3bits-GPTQ / README.md

mahihossain666's picture

Update README.md

c7a2e4a 10 months ago

|

history blame contribute delete

No virus

88 Bytes

metadata

datasets:
  - allenai/c4
license: pddl

Quantized to 3bit precision using AutoGPTQ.