Severian
/

Jamba-Hercules

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Severian commited on Apr 1

Commit

bf597ca

•

1 Parent(s): 52ab766

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -53,14 +53,14 @@ double_quant_config = BitsAndBytesConfig(
 )
 model = AutoModelForCausalLM.from_pretrained(
-    "Severian/Jamba-Nexus-IKM-v1",
     device_map="auto",
     trust_remote_code=True,
     torch_dtype=torch.bfloat16,
     attn_implementation="flash_attention_2",
     quantization_config=double_quant_config,
 )
-tokenizer = AutoTokenizer.from_pretrained("Severian/Jamba-Nexus-IKM-v1")
 input_text = """<|im_start|>system
 You are a helpful AI assistant.

 )
 model = AutoModelForCausalLM.from_pretrained(
+    "Severian/Jamba-Open-Hermes",
     device_map="auto",
     trust_remote_code=True,
     torch_dtype=torch.bfloat16,
     attn_implementation="flash_attention_2",
     quantization_config=double_quant_config,
 )
+tokenizer = AutoTokenizer.from_pretrained("Severian/Jamba-Open-Hermes")
 input_text = """<|im_start|>system
 You are a helpful AI assistant.