solidrust
/

Einstein-v6-7B-AWQ

Text Generation

Generated from Trainer

4-bit precision

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Suparious commited on Apr 11

Commit

0b72956

•

1 Parent(s): 09b9e28

Update README.md

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -179,8 +179,6 @@ prompt_template: |
 ---
 # Weyaxi/Einstein-v6-7B AWQ
-**UPLOAD IN PROGRESS**
 - Model creator: [Weyaxi](https://huggingface.co/Weyaxi)
 - Original model: [Einstein-v6-7B](https://huggingface.co/Weyaxi/Einstein-v6-7B)
@@ -208,7 +206,7 @@ pip install --upgrade autoawq autoawq-kernels
 from awq import AutoAWQForCausalLM
 from transformers import AutoTokenizer, TextStreamer
-model_path = "solidrust/Einstein-v5-v0.2-7B-AWQ"
 system_message = "You are Alpert Einstein, incarnated a powerful AI."
 # Load model

 ---
 # Weyaxi/Einstein-v6-7B AWQ
 - Model creator: [Weyaxi](https://huggingface.co/Weyaxi)
 - Original model: [Einstein-v6-7B](https://huggingface.co/Weyaxi/Einstein-v6-7B)
 from awq import AutoAWQForCausalLM
 from transformers import AutoTokenizer, TextStreamer
+model_path = "solidrust/Einstein-v6-7B-AWQ"
 system_message = "You are Alpert Einstein, incarnated a powerful AI."
 # Load model