screevoai
/

llama3-70b-instruct-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

screevoai commited on Apr 23

Commit

5bd903d

•

1 Parent(s): 1c97ab5

updated README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -2,7 +2,7 @@
 license: other
 base_model: meta-llama/Meta-Llama-3-70B-Instruct
 model-index:
-- name: Llama3-70b-4bit
   results:
   - task:
       name: Text Generation
@@ -18,7 +18,7 @@ tags:
 ---
-# Llama3-70b-4bit
 This model is a quantized version of [meta-llama/Meta-Llama-3-70B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct)
@@ -49,7 +49,7 @@ Run the following command in the terminal/jupyter_notebook:
 >>> import torch
 >>> # Load model and tokenizer
->>> model_id = "screevoai/llama3-70b-4bit"
 >>> tokenizer = AutoTokenizer.from_pretrained(model_id)
 >>> model = AutoModelForCausalLM.from_pretrained(

 license: other
 base_model: meta-llama/Meta-Llama-3-70B-Instruct
 model-index:
+- name: Llama3-70b-Instruct-4bit
   results:
   - task:
       name: Text Generation
 ---
+# Llama3-70b-Instruct-4bit
 This model is a quantized version of [meta-llama/Meta-Llama-3-70B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct)
 >>> import torch
 >>> # Load model and tokenizer
+>>> model_id = "screevoai/llama3-70b-instruct-4bit"
 >>> tokenizer = AutoTokenizer.from_pretrained(model_id)
 >>> model = AutoModelForCausalLM.from_pretrained(