Update README.md

README.md

@@ -10,8 +10,11 @@ GPT2 large model trained on Anthropic/hh-rlhf harmless dataset. It is specifical
 
 It achieves an accuracy of 0.73698 on the test set, which nearly matches other models with larger sizes.
 
-Usage:
+## Usage:
 ```
+import torch
+from transformers import AutoTokenizer, AutoModelForSequenceClassification
+
 rm_tokenizer = AutoTokenizer.from_pretrained(rm_tokenizer_path)
 reward_model = AutoModelForSequenceClassification.from_pretrained(
                 reward_peft_path1,