Update README.md

README.md

@@ -19,6 +19,33 @@ This model is a RetNet model trained from scratch using https://github.com/syncd
 
 Demo: https://huggingface.co/spaces/p1atdev/LightNovel-Intro-RetNet-400M-Demo
 
+## Usage
+
+```py
+from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig
+
+MODEL_NAME = "p1atdev/LightNovel-Intro-RetNet-400M"
+
+device = "cuda"
+
+tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)
+model = AutoModelForCausalLM.from_pretrained(
+    MODEL_NAME,
+    trust_remote_code=True,
+).to(device)
+gen_config = GenerationConfig.from_pretrained(MODEL_NAME)
+gen_config.max_new_tokens = 32
+
+inputs = tokenizer("目が覚めると、", return_tensors="pt", add_special_tokens=False).to(device)
+
+print("Generating...")
+
+result = model.generate(**inputs, generation_config=gen_config)
+
+print(tokenizer.decode(result[0], skip_special_tokens=True))
+# 目が覚めると、見知らぬ空間に居た。 「ん......?」 思わずそんな声が出たことに違和感を感じる。確か、気付けば私は
+```
+
 ## Model description
 
 More information needed