Update README.md

README.md

@@ -6,9 +6,9 @@ metrics:
 - accuracy
 ---
 
-GPT2 large model trained on Anthropic/hh-rlhf harmless dataset. It is specifically used for harmful response detection or RLHF. Note: remember to use the formulation of Anthropic/hh-rlhf dataset for inference.
+GPT2 large model trained on Anthropic/hh-rlhf harmless dataset. It is specifically used for harmful response detection or RLHF. Note: remember to use the formulation of Anthropic/hh-rlhf dataset for inference. It achieves an accuracy of 0.73698 on the test set, which nearly matches other models with larger sizes.
 
-It achieves an accuracy of 0.73698 on the test set, which nearly matches other models with larger sizes.
+Note: 1. Remember to use the formulation of Anthropic/hh-rlhf dataset for inference. 2. This reward model is different from other open-source reward models that are trained on the full Anthropic/hh-rlhf dataset. 
 
 ## Usage:
 ```