cloudyu
/

mistral_pretrain_demo

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

cloudyu commited on Mar 7

Commit

382e75b

•

1 Parent(s): b72c0a5

Update mistral_pretrain.py

Files changed (1) hide show

mistral_pretrain.py +2 -2

mistral_pretrain.py CHANGED Viewed

@@ -15,8 +15,8 @@ configuration = MistralConfig(vocab_size=32000,
         bos_token_id=1,
         eos_token_id=2)
-#model = MistralForCausalLM(configuration)
-model = MistralForCausalLM.from_pretrained("./6B_code_outputs/checkpoint-10000")
 tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2", local_files_only=False)
 tokenizer.pad_token = tokenizer.eos_token

         bos_token_id=1,
         eos_token_id=2)
+model = MistralForCausalLM(configuration)
+#model = MistralForCausalLM.from_pretrained("./6B_code_outputs/checkpoint-10000")
 tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2", local_files_only=False)
 tokenizer.pad_token = tokenizer.eos_token