LoftQ
/

Meta-Llama-3-70B-Instruct-4bit-64rank

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

LoftQ commited on May 2

Commit

6544b49

•

1 Parent(s): 90ad83f

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "/mnt/t-qingzhang/yxli2123_model_zoo/Meta-Llama-3-70B-Instruct-4bit-64rank-1iter",
   "architectures": [
     "LlamaForCausalLM"
   ],

 {
+  "_name_or_path": "LoftQ/Meta-Llama-3-70B-Instruct-4bit-64rank",
   "architectures": [
     "LlamaForCausalLM"
   ],