Before revision:  In this paper, we describe a technique for fine-tuning GPT-2 such that the amount of non-normative content generated is significantly reduced. A model capable of classifying normative behavior is used to produce an additional reward signal;
After revision:  In this paper, we describe a technique for fine-tuning GPT-2 , using