cortecs
/

Meta-Llama-3-70B-Instruct-GPTQ-8b

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

markoarnauto commited on Jun 18

Commit

0ef4bea

•

1 Parent(s): 6280b27

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@ datasets: wikitext
 license: other
 license_link: https://llama.meta.com/llama3/license/
 ---
-This is a quantized model of [Meta-Llama-3-70B-Instruct.yaml](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct.yaml) using GPTQ developed by [IST Austria](https://ist.ac.at/en/research/alistarh-group/)
  using the following configuration:
  - 8bit
 - Act order: True

 license: other
 license_link: https://llama.meta.com/llama3/license/
 ---
+This is a quantized model of [Meta-Llama-3-70B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) using GPTQ developed by [IST Austria](https://ist.ac.at/en/research/alistarh-group/)
  using the following configuration:
  - 8bit
 - Act order: True