Update README.md

README.md

@@ -74,12 +74,15 @@ tags:
 Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
 
 ## How to Get Started with the Model
-
+<code>
   import torch
-  from transformers import AutoModelForCausalLM, AutoTokenizer
-  
-  tokenizer = AutoTokenizer.from_pretrained("shpotes/codegen-350M-mono")
-  model = AutoModelForCausalLM.from_pretrained("shpotes/codegen-350M-mono", trust_remote_code=True)
+  from transformers import AutoModelForCausalLM
+  from peft import PeftModel, PeftConfig
+  from transformers import AutoModelForCausalLM
+
+  config = PeftConfig.from_pretrained("yamete4/codegen-350M-mono-QLoRa-flytech")
+  model = AutoModelForCausalLM.from_pretrained("shpotes/codegen-350M-mono")
+  model = PeftModel.from_pretrained(model, "yamete4/codegen-350M-mono-QLoRa-flytech")
   
   input_ids = tokenizer(
       context,
@@ -104,7 +107,7 @@ Users (both direct and downstream) should be made aware of the risks, biases and
     )
     text = tokenizer.batch_decode(tokens[:, input_ids_len:, ...])
 
-
+</code>
 [More Information Needed]
 
 ## Training Details